2023-01-25T09:28:42.772 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1 2023-01-25T09:28:42.773 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137182 --verbose --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps} --name yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137182/orig.config.yaml 2023-01-25T09:28:42.819 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-25T09:28:42.920 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137182 branch: wip-yuri6-testing-2023-01-24-0746 description: rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps} email: yweinstein@radhat.com first_in_suite: false job_id: '7137182' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 - volumes: size: 50 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri6-testing-2023-01-24-0746 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 2500 ms tcp read timeout: 5 ms type: async osd_max_pg_log_entries: 2 osd_min_pg_log_entries: 1 osd_pg_log_trim_min: 0 osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore queue throttle high multiple: 2 filestore queue throttle max multiple: 10 journal throttle high multiple: 2 journal throttle max multiple: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd max backfills: 9 osd max markdown count: 1000 osd max scrubs: 3 osd mclock override recovery settings: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd_max_pg_log_entries: 3000 osd_min_pg_log_entries: 3000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - must scrub before tier agent can activate mon_bind_msgr2: false sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 min_in: 4 workunit: branch: wip-yuri6-testing-2023-01-24-0746 sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri6-testing-2023-01-24-0746 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c targets: smithi035.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi138.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: chance_pgnum_grow: 3 chance_pgpnum_fix: 1 timeout: 1200 - exec: client.0: - sudo ceph osd pool create base 4 - sudo ceph osd pool application enable base rados - sudo ceph osd pool create cache 4 - sudo ceph osd tier add base cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay base cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 3600 - sudo ceph osd pool set cache target_max_objects 250 - sudo ceph osd pool set cache min_read_recency_for_promote 2 - rados: clients: - client.0 objects: 500 op_weights: cache_evict: 50 cache_flush: 50 cache_try_flush: 50 copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 pools: - base teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e1bba12e584b7ae912e92e94afe9c075ab51fa3 timestamp: 2023-01-24_22:27:30 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.17735 2023-01-25T09:28:42.921 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa; will attempt to use it 2023-01-25T09:28:42.921 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa/tasks 2023-01-25T09:28:42.922 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-25T09:28:42.924 INFO:teuthology.task.internal:Checking packages... 2023-01-25T09:28:42.950 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '44e4095da12a8269eb6cfe163cbb0d00b1a6412c' 2023-01-25T09:28:42.950 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-25T09:28:42.950 INFO:teuthology.packaging:ref: None 2023-01-25T09:28:42.951 INFO:teuthology.packaging:tag: None 2023-01-25T09:28:42.951 INFO:teuthology.packaging:branch: wip-yuri6-testing-2023-01-24-0746 2023-01-25T09:28:42.951 INFO:teuthology.packaging:sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:28:42.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri6-testing-2023-01-24-0746 2023-01-25T09:28:43.147 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-1986-g44e4095d-1focal 2023-01-25T09:28:43.147 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-25T09:28:43.156 INFO:teuthology.task.internal:no buildpackages task found 2023-01-25T09:28:43.156 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-25T09:28:43.181 INFO:teuthology.task.internal:Saving configuration 2023-01-25T09:28:43.199 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-25T09:28:43.207 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-25T09:28:43.229 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi035.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137182', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 09:22:37.402168', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-01-25T09:28:43.251 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137182', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 09:22:37.400694', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-01-25T09:28:43.251 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-25T09:28:43.259 INFO:teuthology.task.internal:roles: ubuntu@smithi035.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-01-25T09:28:43.259 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-01-25T09:28:43.260 INFO:teuthology.run_tasks:Running task console_log... 2023-01-25T09:28:43.329 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f12de3a2670>, signals=[15]) 2023-01-25T09:28:43.330 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-25T09:28:43.338 INFO:teuthology.task.internal:Opening connections... 2023-01-25T09:28:43.338 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi035.front.sepia.ceph.com 2023-01-25T09:28:43.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:28:43.394 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2023-01-25T09:28:43.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:28:43.446 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-25T09:28:43.454 DEBUG:teuthology.orchestra.run.smithi035:> uname -m 2023-01-25T09:28:43.474 INFO:teuthology.orchestra.run.smithi035.stdout:x86_64 2023-01-25T09:28:43.475 DEBUG:teuthology.orchestra.run.smithi035:> cat /etc/os-release 2023-01-25T09:28:43.480 INFO:teuthology.orchestra.run.smithi035.stdout:NAME="Ubuntu" 2023-01-25T09:28:43.480 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-25T09:28:43.480 INFO:teuthology.orchestra.run.smithi035.stdout:ID=ubuntu 2023-01-25T09:28:43.480 INFO:teuthology.orchestra.run.smithi035.stdout:ID_LIKE=debian 2023-01-25T09:28:43.480 INFO:teuthology.orchestra.run.smithi035.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-25T09:28:43.481 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION_ID="20.04" 2023-01-25T09:28:43.481 INFO:teuthology.orchestra.run.smithi035.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-25T09:28:43.481 INFO:teuthology.orchestra.run.smithi035.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-25T09:28:43.481 INFO:teuthology.orchestra.run.smithi035.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-25T09:28:43.482 INFO:teuthology.orchestra.run.smithi035.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-25T09:28:43.482 INFO:teuthology.orchestra.run.smithi035.stdout:VERSION_CODENAME=focal 2023-01-25T09:28:43.482 INFO:teuthology.orchestra.run.smithi035.stdout:UBUNTU_CODENAME=focal 2023-01-25T09:28:43.483 INFO:teuthology.lock.ops:Updating smithi035.front.sepia.ceph.com on lock server 2023-01-25T09:28:43.501 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2023-01-25T09:28:43.523 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2023-01-25T09:28:43.524 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-01-25T09:28:43.573 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2023-01-25T09:28:43.573 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-25T09:28:43.573 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2023-01-25T09:28:43.574 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2023-01-25T09:28:43.574 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-25T09:28:43.575 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="20.04" 2023-01-25T09:28:43.576 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-25T09:28:43.576 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-25T09:28:43.576 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-25T09:28:43.576 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-25T09:28:43.577 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=focal 2023-01-25T09:28:43.577 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=focal 2023-01-25T09:28:43.577 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-01-25T09:28:43.595 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-25T09:28:43.606 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-25T09:28:43.616 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-25T09:28:43.616 DEBUG:teuthology.orchestra.run.smithi035:> test '!' -e /home/ubuntu/cephtest 2023-01-25T09:28:43.619 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2023-01-25T09:28:43.625 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-25T09:28:43.631 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-25T09:28:43.631 DEBUG:teuthology.orchestra.run.smithi035:> test -z $(ls -A /var/lib/ceph) 2023-01-25T09:28:43.633 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2023-01-25T09:28:43.651 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-25T09:28:43.715 INFO:teuthology.run_tasks:Running task kernel... 2023-01-25T09:28:43.733 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-25T09:28:43.733 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-25T09:28:43.734 DEBUG:teuthology.orchestra.run.smithi035:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T09:28:43.735 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T09:28:43.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:28:43.740 DEBUG:teuthology.orchestra.run.smithi035:> uname -r 2023-01-25T09:28:43.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:28:43.742 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2023-01-25T09:28:43.748 INFO:teuthology.orchestra.run.smithi035.stdout:5.4.0-124-generic 2023-01-25T09:28:43.748 INFO:teuthology.task.kernel:Running kernel on smithi035: 5.4.0-124-generic 2023-01-25T09:28:43.749 DEBUG:teuthology.orchestra.run.smithi035:> sudo apt-get clean 2023-01-25T09:28:43.750 INFO:teuthology.orchestra.run.smithi138.stdout:5.4.0-124-generic 2023-01-25T09:28:43.750 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.4.0-124-generic 2023-01-25T09:28:43.750 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2023-01-25T09:28:43.860 DEBUG:teuthology.orchestra.run.smithi035:> sudo apt-get update 2023-01-25T09:28:43.874 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2023-01-25T09:28:44.058 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T09:28:44.058 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-01-25T09:28:44.059 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-01-25T09:28:44.116 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-01-25T09:28:44.185 INFO:teuthology.orchestra.run.smithi035.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T09:28:44.186 INFO:teuthology.orchestra.run.smithi035.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-01-25T09:28:44.240 INFO:teuthology.orchestra.run.smithi035.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-01-25T09:28:44.459 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,960 kB] 2023-01-25T09:28:44.570 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [543 kB] 2023-01-25T09:28:44.578 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [320 kB] 2023-01-25T09:28:44.581 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [11.7 kB] 2023-01-25T09:28:44.582 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [29.1 kB] 2023-01-25T09:28:44.582 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,463 kB] 2023-01-25T09:28:44.587 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,359 kB] 2023-01-25T09:28:44.594 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [207 kB] 2023-01-25T09:28:44.596 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [624 B] 2023-01-25T09:28:44.596 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [576 kB] 2023-01-25T09:28:44.601 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [787 kB] 2023-01-25T09:28:44.606 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [152 kB] 2023-01-25T09:28:44.607 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [16.9 kB] 2023-01-25T09:28:44.622 INFO:teuthology.orchestra.run.smithi035.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-01-25T09:28:44.684 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [780 kB] 2023-01-25T09:28:44.686 INFO:teuthology.orchestra.run.smithi035.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,960 kB] 2023-01-25T09:28:44.687 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [404 kB] 2023-01-25T09:28:44.690 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.2 kB] 2023-01-25T09:28:44.690 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,560 kB] 2023-01-25T09:28:44.700 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [30.4 kB] 2023-01-25T09:28:44.701 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [220 kB] 2023-01-25T09:28:44.702 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [620 B] 2023-01-25T09:28:44.703 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [708 kB] 2023-01-25T09:28:44.707 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,019 kB] 2023-01-25T09:28:44.714 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [236 kB] 2023-01-25T09:28:44.715 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [23.4 kB] 2023-01-25T09:28:44.720 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-01-25T09:28:44.721 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-01-25T09:28:44.721 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [604 B] 2023-01-25T09:28:44.721 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [24.9 kB] 2023-01-25T09:28:44.721 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-01-25T09:28:44.722 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-01-25T09:28:44.833 INFO:teuthology.orchestra.run.smithi035.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,359 kB] 2023-01-25T09:28:45.355 INFO:teuthology.orchestra.run.smithi035.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [543 kB] 2023-01-25T09:28:45.355 INFO:teuthology.orchestra.run.smithi035.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [780 kB] 2023-01-25T09:28:45.371 INFO:teuthology.orchestra.run.smithi035.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [320 kB] 2023-01-25T09:28:45.374 INFO:teuthology.orchestra.run.smithi035.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [404 kB] 2023-01-25T09:28:45.381 INFO:teuthology.orchestra.run.smithi035.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [11.7 kB] 2023-01-25T09:28:45.381 INFO:teuthology.orchestra.run.smithi035.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,463 kB] 2023-01-25T09:28:45.384 INFO:teuthology.orchestra.run.smithi035.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.2 kB] 2023-01-25T09:28:45.385 INFO:teuthology.orchestra.run.smithi035.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,560 kB] 2023-01-25T09:28:45.452 INFO:teuthology.orchestra.run.smithi035.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [30.4 kB] 2023-01-25T09:28:45.453 INFO:teuthology.orchestra.run.smithi035.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [220 kB] 2023-01-25T09:28:45.454 INFO:teuthology.orchestra.run.smithi035.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [29.1 kB] 2023-01-25T09:28:45.454 INFO:teuthology.orchestra.run.smithi035.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [207 kB] 2023-01-25T09:28:45.458 INFO:teuthology.orchestra.run.smithi035.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [620 B] 2023-01-25T09:28:45.459 INFO:teuthology.orchestra.run.smithi035.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [708 kB] 2023-01-25T09:28:45.460 INFO:teuthology.orchestra.run.smithi035.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [624 B] 2023-01-25T09:28:45.460 INFO:teuthology.orchestra.run.smithi035.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [576 kB] 2023-01-25T09:28:45.477 INFO:teuthology.orchestra.run.smithi035.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,019 kB] 2023-01-25T09:28:45.478 INFO:teuthology.orchestra.run.smithi035.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [787 kB] 2023-01-25T09:28:45.503 INFO:teuthology.orchestra.run.smithi035.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [152 kB] 2023-01-25T09:28:45.503 INFO:teuthology.orchestra.run.smithi035.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [236 kB] 2023-01-25T09:28:45.507 INFO:teuthology.orchestra.run.smithi035.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [16.9 kB] 2023-01-25T09:28:45.508 INFO:teuthology.orchestra.run.smithi035.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [23.4 kB] 2023-01-25T09:28:45.550 INFO:teuthology.orchestra.run.smithi035.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-01-25T09:28:45.551 INFO:teuthology.orchestra.run.smithi035.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-01-25T09:28:45.551 INFO:teuthology.orchestra.run.smithi035.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [604 B] 2023-01-25T09:28:45.551 INFO:teuthology.orchestra.run.smithi035.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-01-25T09:28:45.552 INFO:teuthology.orchestra.run.smithi035.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [24.9 kB] 2023-01-25T09:28:45.557 INFO:teuthology.orchestra.run.smithi035.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-01-25T09:28:48.042 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 13.8 MB in 2s (6,540 kB/s) 2023-01-25T09:28:48.860 INFO:teuthology.orchestra.run.smithi035.stdout:Fetched 13.8 MB in 3s (4,740 kB/s) 2023-01-25T09:28:49.433 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-01-25T09:28:49.456 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-25T09:28:49.539 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-01-25T09:28:49.704 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2023-01-25T09:28:49.705 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2023-01-25T09:28:49.860 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2023-01-25T09:28:49.860 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-25T09:28:49.861 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-generic linux-image-5.4.0-137-generic 2023-01-25T09:28:49.861 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-5.4.0-137-generic linux-modules-extra-5.4.0-137-generic 2023-01-25T09:28:49.862 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2023-01-25T09:28:49.862 INFO:teuthology.orchestra.run.smithi138.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-01-25T09:28:49.862 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2023-01-25T09:28:49.862 INFO:teuthology.orchestra.run.smithi138.stdout: thermald 2023-01-25T09:28:49.929 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2023-01-25T09:28:49.929 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-25T09:28:49.930 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-137-generic linux-modules-5.4.0-137-generic 2023-01-25T09:28:49.930 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-extra-5.4.0-137-generic 2023-01-25T09:28:49.931 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2023-01-25T09:28:49.932 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-generic linux-image-generic 2023-01-25T09:28:50.130 INFO:teuthology.orchestra.run.smithi138.stdout:3 upgraded, 5 newly installed, 0 to remove and 129 not upgraded. 2023-01-25T09:28:50.130 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 77.1 MB of archives. 2023-01-25T09:28:50.131 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 380 MB of additional disk space will be used. 2023-01-25T09:28:50.131 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-137-generic amd64 5.4.0-137.154 [15.0 MB] 2023-01-25T09:28:50.230 INFO:teuthology.orchestra.run.smithi035.stdout:Reading package lists... 2023-01-25T09:28:50.254 DEBUG:teuthology.orchestra.run.smithi035:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-25T09:28:50.322 INFO:teuthology.orchestra.run.smithi035.stdout:Reading package lists... 2023-01-25T09:28:50.512 INFO:teuthology.orchestra.run.smithi035.stdout:Building dependency tree... 2023-01-25T09:28:50.512 INFO:teuthology.orchestra.run.smithi035.stdout:Reading state information... 2023-01-25T09:28:50.687 INFO:teuthology.orchestra.run.smithi035.stdout:The following additional packages will be installed: 2023-01-25T09:28:50.688 INFO:teuthology.orchestra.run.smithi035.stdout: linux-generic linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-25T09:28:50.688 INFO:teuthology.orchestra.run.smithi035.stdout: linux-headers-generic linux-image-5.4.0-137-generic 2023-01-25T09:28:50.689 INFO:teuthology.orchestra.run.smithi035.stdout: linux-modules-5.4.0-137-generic linux-modules-extra-5.4.0-137-generic 2023-01-25T09:28:50.690 INFO:teuthology.orchestra.run.smithi035.stdout:Suggested packages: 2023-01-25T09:28:50.690 INFO:teuthology.orchestra.run.smithi035.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-01-25T09:28:50.690 INFO:teuthology.orchestra.run.smithi035.stdout:Recommended packages: 2023-01-25T09:28:50.690 INFO:teuthology.orchestra.run.smithi035.stdout: thermald 2023-01-25T09:28:50.746 INFO:teuthology.orchestra.run.smithi035.stdout:The following NEW packages will be installed: 2023-01-25T09:28:50.747 INFO:teuthology.orchestra.run.smithi035.stdout: linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-25T09:28:50.747 INFO:teuthology.orchestra.run.smithi035.stdout: linux-image-5.4.0-137-generic linux-modules-5.4.0-137-generic 2023-01-25T09:28:50.747 INFO:teuthology.orchestra.run.smithi035.stdout: linux-modules-extra-5.4.0-137-generic 2023-01-25T09:28:50.748 INFO:teuthology.orchestra.run.smithi035.stdout:The following packages will be upgraded: 2023-01-25T09:28:50.749 INFO:teuthology.orchestra.run.smithi035.stdout: linux-generic linux-headers-generic linux-image-generic 2023-01-25T09:28:50.800 INFO:teuthology.orchestra.run.smithi035.stdout:3 upgraded, 5 newly installed, 0 to remove and 129 not upgraded. 2023-01-25T09:28:50.800 INFO:teuthology.orchestra.run.smithi035.stdout:Need to get 77.1 MB of archives. 2023-01-25T09:28:50.800 INFO:teuthology.orchestra.run.smithi035.stdout:After this operation, 380 MB of additional disk space will be used. 2023-01-25T09:28:50.801 INFO:teuthology.orchestra.run.smithi035.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-137-generic amd64 5.4.0-137.154 [15.0 MB] 2023-01-25T09:28:51.125 INFO:teuthology.orchestra.run.smithi035.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-137-generic amd64 5.4.0-137.154 [10.5 MB] 2023-01-25T09:28:51.219 INFO:teuthology.orchestra.run.smithi035.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-137-generic amd64 5.4.0-137.154 [39.2 MB] 2023-01-25T09:28:51.375 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-137-generic amd64 5.4.0-137.154 [10.5 MB] 2023-01-25T09:28:51.675 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-137-generic amd64 5.4.0-137.154 [39.2 MB] 2023-01-25T09:28:51.679 INFO:teuthology.orchestra.run.smithi035.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.137.135 [1,896 B] 2023-01-25T09:28:51.680 INFO:teuthology.orchestra.run.smithi035.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.137.135 [2,528 B] 2023-01-25T09:28:51.680 INFO:teuthology.orchestra.run.smithi035.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137 all 5.4.0-137.154 [11.0 MB] 2023-01-25T09:28:51.775 INFO:teuthology.orchestra.run.smithi035.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137-generic amd64 5.4.0-137.154 [1,400 kB] 2023-01-25T09:28:51.786 INFO:teuthology.orchestra.run.smithi035.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.137.135 [2,392 B] 2023-01-25T09:28:52.489 INFO:teuthology.orchestra.run.smithi035.stdout:Fetched 77.1 MB in 1s (74.8 MB/s) 2023-01-25T09:28:52.689 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package linux-modules-5.4.0-137-generic. 2023-01-25T09:28:53.097 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.137.135 [1,896 B] 2023-01-25T09:28:53.098 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.137.135 [2,528 B] 2023-01-25T09:28:53.098 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137 all 5.4.0-137.154 [11.0 MB] 2023-01-25T09:28:53.402 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137-generic amd64 5.4.0-137.154 [1,400 kB] 2023-01-25T09:28:53.436 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.137.135 [2,392 B] 2023-01-25T09:28:54.104 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 77.1 MB in 3s (22.0 MB/s) 2023-01-25T09:28:54.298 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-5.4.0-137-generic. 2023-01-25T09:28:54.419 INFO:teuthology.orchestra.run.smithi035.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-01-25T09:28:54.424 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../0-linux-modules-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:28:54.638 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:28:56.039 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-01-25T09:28:56.044 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../0-linux-modules-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:28:56.138 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:28:56.548 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package linux-image-5.4.0-137-generic. 2023-01-25T09:28:56.564 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../1-linux-image-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:28:56.665 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:28:57.768 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-137-generic. 2023-01-25T09:28:57.782 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:28:57.826 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:28:58.109 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-image-5.4.0-137-generic. 2023-01-25T09:28:58.123 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../1-linux-image-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:28:58.217 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:28:59.262 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-137-generic. 2023-01-25T09:28:59.276 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:28:59.346 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:02.826 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../3-linux-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T09:29:02.952 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking linux-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T09:29:03.335 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T09:29:03.489 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking linux-image-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T09:29:03.826 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package linux-headers-5.4.0-137. 2023-01-25T09:29:03.842 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../5-linux-headers-5.4.0-137_5.4.0-137.154_all.deb ... 2023-01-25T09:29:03.909 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-25T09:29:04.268 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../3-linux-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T09:29:04.420 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T09:29:04.739 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T09:29:04.891 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T09:29:05.178 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.4.0-137. 2023-01-25T09:29:05.195 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../5-linux-headers-5.4.0-137_5.4.0-137.154_all.deb ... 2023-01-25T09:29:05.236 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-25T09:29:09.576 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package linux-headers-5.4.0-137-generic. 2023-01-25T09:29:09.597 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../6-linux-headers-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:29:09.634 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:10.729 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.4.0-137-generic. 2023-01-25T09:29:10.751 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../6-linux-headers-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-25T09:29:10.787 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:12.415 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T09:29:12.567 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking linux-headers-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T09:29:12.900 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-25T09:29:13.038 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:13.633 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.137.135_amd64.deb ... 2023-01-25T09:29:13.754 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-25T09:29:14.113 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-25T09:29:14.241 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:14.923 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:15.049 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:15.435 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:15.587 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:16.256 INFO:teuthology.orchestra.run.smithi035.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-137-generic 2023-01-25T09:29:16.256 INFO:teuthology.orchestra.run.smithi035.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-137-generic 2023-01-25T09:29:16.393 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:16.733 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-137-generic 2023-01-25T09:29:16.733 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-137-generic 2023-01-25T09:29:16.855 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:17.619 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up linux-image-generic (5.4.0.137.135) ... 2023-01-25T09:29:17.745 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up linux-headers-generic (5.4.0.137.135) ... 2023-01-25T09:29:17.905 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up linux-generic (5.4.0.137.135) ... 2023-01-25T09:29:18.031 INFO:teuthology.orchestra.run.smithi035.stdout:Processing triggers for linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:18.110 INFO:teuthology.orchestra.run.smithi035.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-01-25T09:29:18.110 INFO:teuthology.orchestra.run.smithi035.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-137-generic 2023-01-25T09:29:18.565 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-generic (5.4.0.137.135) ... 2023-01-25T09:29:18.733 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-generic (5.4.0.137.135) ... 2023-01-25T09:29:18.859 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-generic (5.4.0.137.135) ... 2023-01-25T09:29:18.994 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-25T09:29:19.067 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-01-25T09:29:19.068 INFO:teuthology.orchestra.run.smithi138.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-137-generic 2023-01-25T09:29:40.926 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-01-25T09:29:40.927 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub' 2023-01-25T09:29:40.928 INFO:teuthology.orchestra.run.smithi035.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-01-25T09:29:40.929 INFO:teuthology.orchestra.run.smithi035.stdout:Sourcing file `/etc/default/grub' 2023-01-25T09:29:40.931 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-25T09:29:40.945 INFO:teuthology.orchestra.run.smithi138.stdout:Generating grub configuration file ... 2023-01-25T09:29:40.946 INFO:teuthology.orchestra.run.smithi035.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-25T09:29:40.970 INFO:teuthology.orchestra.run.smithi035.stdout:Generating grub configuration file ... 2023-01-25T09:29:41.364 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-25T09:29:41.386 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-25T09:29:41.405 INFO:teuthology.orchestra.run.smithi035.stdout:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-25T09:29:41.437 INFO:teuthology.orchestra.run.smithi035.stdout:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-25T09:29:41.859 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-25T09:29:41.871 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-25T09:29:41.896 INFO:teuthology.orchestra.run.smithi035.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-25T09:29:41.908 INFO:teuthology.orchestra.run.smithi035.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-25T09:29:44.410 INFO:teuthology.orchestra.run.smithi035.stdout:done 2023-01-25T09:29:44.603 INFO:teuthology.orchestra.run.smithi138.stdout:done 2023-01-25T09:29:44.854 DEBUG:teuthology.orchestra.run.smithi035:> dpkg -s linux-image-generic 2023-01-25T09:29:44.897 INFO:teuthology.orchestra.run.smithi035.stdout:Package: linux-image-generic 2023-01-25T09:29:44.897 INFO:teuthology.orchestra.run.smithi035.stdout:Status: install ok installed 2023-01-25T09:29:44.897 INFO:teuthology.orchestra.run.smithi035.stdout:Priority: optional 2023-01-25T09:29:44.898 INFO:teuthology.orchestra.run.smithi035.stdout:Section: kernel 2023-01-25T09:29:44.898 INFO:teuthology.orchestra.run.smithi035.stdout:Installed-Size: 19 2023-01-25T09:29:44.898 INFO:teuthology.orchestra.run.smithi035.stdout:Maintainer: Ubuntu Kernel Team 2023-01-25T09:29:44.898 INFO:teuthology.orchestra.run.smithi035.stdout:Architecture: amd64 2023-01-25T09:29:44.898 INFO:teuthology.orchestra.run.smithi035.stdout:Source: linux-meta 2023-01-25T09:29:44.899 INFO:teuthology.orchestra.run.smithi035.stdout:Version: 5.4.0.137.135 2023-01-25T09:29:44.899 INFO:teuthology.orchestra.run.smithi035.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-25T09:29:44.899 INFO:teuthology.orchestra.run.smithi035.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-25T09:29:44.899 INFO:teuthology.orchestra.run.smithi035.stdout:Recommends: thermald 2023-01-25T09:29:44.899 INFO:teuthology.orchestra.run.smithi035.stdout:Description: Generic Linux kernel image 2023-01-25T09:29:44.900 INFO:teuthology.orchestra.run.smithi035.stdout: This package will always depend on the latest generic kernel image 2023-01-25T09:29:44.900 INFO:teuthology.orchestra.run.smithi035.stdout: available. 2023-01-25T09:29:44.900 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-137-generic 2023-01-25T09:29:44.900 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T09:29:44.901 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T09:29:44.901 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-01-25T09:29:44.901 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi035.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T09:29:44.901 DEBUG:teuthology.orchestra.run.smithi035:> sudo apt-get clean 2023-01-25T09:29:44.998 DEBUG:teuthology.orchestra.run.smithi035:> sudo apt-get update 2023-01-25T09:29:45.052 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2023-01-25T09:29:45.103 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2023-01-25T09:29:45.103 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2023-01-25T09:29:45.103 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2023-01-25T09:29:45.104 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2023-01-25T09:29:45.104 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 19 2023-01-25T09:29:45.104 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2023-01-25T09:29:45.104 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2023-01-25T09:29:45.104 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2023-01-25T09:29:45.105 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.4.0.137.135 2023-01-25T09:29:45.105 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-25T09:29:45.105 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-25T09:29:45.105 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2023-01-25T09:29:45.105 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2023-01-25T09:29:45.106 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2023-01-25T09:29:45.106 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2023-01-25T09:29:45.106 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-137-generic 2023-01-25T09:29:45.106 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T09:29:45.107 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T09:29:45.107 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-01-25T09:29:45.107 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T09:29:45.108 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2023-01-25T09:29:45.209 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2023-01-25T09:29:45.278 INFO:teuthology.orchestra.run.smithi035.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T09:29:45.279 INFO:teuthology.orchestra.run.smithi035.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-25T09:29:45.339 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-25T09:29:45.360 INFO:teuthology.orchestra.run.smithi035.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-25T09:29:45.450 INFO:teuthology.orchestra.run.smithi035.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-25T09:29:45.477 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T09:29:45.568 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-25T09:29:45.659 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-25T09:29:46.971 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-01-25T09:29:46.996 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-25T09:29:47.026 INFO:teuthology.orchestra.run.smithi035.stdout:Reading package lists... 2023-01-25T09:29:47.049 DEBUG:teuthology.orchestra.run.smithi035:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-25T09:29:47.064 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-01-25T09:29:47.118 INFO:teuthology.orchestra.run.smithi035.stdout:Reading package lists... 2023-01-25T09:29:47.229 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2023-01-25T09:29:47.229 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2023-01-25T09:29:47.291 INFO:teuthology.orchestra.run.smithi035.stdout:Building dependency tree... 2023-01-25T09:29:47.292 INFO:teuthology.orchestra.run.smithi035.stdout:Reading state information... 2023-01-25T09:29:47.416 INFO:teuthology.orchestra.run.smithi138.stdout:linux-image-generic is already the newest version (5.4.0.137.135). 2023-01-25T09:29:47.417 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 0 newly installed, 0 to remove and 129 not upgraded. 2023-01-25T09:29:47.418 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2023-01-25T09:29:47.439 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2023-01-25T09:29:47.439 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2023-01-25T09:29:47.440 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2023-01-25T09:29:47.440 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2023-01-25T09:29:47.440 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 19 2023-01-25T09:29:47.440 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2023-01-25T09:29:47.440 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2023-01-25T09:29:47.441 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2023-01-25T09:29:47.441 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.4.0.137.135 2023-01-25T09:29:47.441 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-25T09:29:47.441 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-25T09:29:47.441 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2023-01-25T09:29:47.442 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2023-01-25T09:29:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2023-01-25T09:29:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2023-01-25T09:29:47.443 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2023-01-25T09:29:47.448 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.GpSleWQ0CA 2023-01-25T09:29:47.448 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GpSleWQ0CA 2023-01-25T09:29:47.492 INFO:teuthology.orchestra.run.smithi035.stdout:linux-image-generic is already the newest version (5.4.0.137.135). 2023-01-25T09:29:47.492 INFO:teuthology.orchestra.run.smithi035.stdout:0 upgraded, 0 newly installed, 0 to remove and 129 not upgraded. 2023-01-25T09:29:47.494 DEBUG:teuthology.orchestra.run.smithi035:> dpkg -s linux-image-generic 2023-01-25T09:29:47.507 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.GpSleWQ0CA 2023-01-25T09:29:47.515 INFO:teuthology.orchestra.run.smithi035.stdout:Package: linux-image-generic 2023-01-25T09:29:47.516 INFO:teuthology.orchestra.run.smithi035.stdout:Status: install ok installed 2023-01-25T09:29:47.516 INFO:teuthology.orchestra.run.smithi035.stdout:Priority: optional 2023-01-25T09:29:47.516 INFO:teuthology.orchestra.run.smithi035.stdout:Section: kernel 2023-01-25T09:29:47.516 INFO:teuthology.orchestra.run.smithi035.stdout:Installed-Size: 19 2023-01-25T09:29:47.517 INFO:teuthology.orchestra.run.smithi035.stdout:Maintainer: Ubuntu Kernel Team 2023-01-25T09:29:47.517 INFO:teuthology.orchestra.run.smithi035.stdout:Architecture: amd64 2023-01-25T09:29:47.517 INFO:teuthology.orchestra.run.smithi035.stdout:Source: linux-meta 2023-01-25T09:29:47.517 INFO:teuthology.orchestra.run.smithi035.stdout:Version: 5.4.0.137.135 2023-01-25T09:29:47.517 INFO:teuthology.orchestra.run.smithi035.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-25T09:29:47.518 INFO:teuthology.orchestra.run.smithi035.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-25T09:29:47.518 INFO:teuthology.orchestra.run.smithi035.stdout:Recommends: thermald 2023-01-25T09:29:47.518 INFO:teuthology.orchestra.run.smithi035.stdout:Description: Generic Linux kernel image 2023-01-25T09:29:47.518 INFO:teuthology.orchestra.run.smithi035.stdout: This package will always depend on the latest generic kernel image 2023-01-25T09:29:47.518 INFO:teuthology.orchestra.run.smithi035.stdout: available. 2023-01-25T09:29:47.519 DEBUG:teuthology.orchestra.run.smithi035:> mktemp 2023-01-25T09:29:47.548 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.GpSleWQ0CA is 9KB 2023-01-25T09:29:47.563 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.GpSleWQ0CA 2023-01-25T09:29:47.564 INFO:teuthology.orchestra.run.smithi035.stdout:/tmp/tmp.Ik3IIULeAj 2023-01-25T09:29:47.564 DEBUG:teuthology.orchestra.run.smithi035:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Ik3IIULeAj 2023-01-25T09:29:47.571 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-01-25T09:29:47.579 DEBUG:teuthology.orchestra.run.smithi035:> sudo chmod 0666 /tmp/tmp.Ik3IIULeAj 2023-01-25T09:29:47.613 DEBUG:teuthology.orchestra.remote:smithi035:/tmp/tmp.Ik3IIULeAj is 9KB 2023-01-25T09:29:47.623 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:29:47.624 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-01-25T09:29:47.624 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-01-25T09:29:47.629 DEBUG:teuthology.orchestra.run.smithi035:> rm -fr /tmp/tmp.Ik3IIULeAj 2023-01-25T09:29:47.635 DEBUG:teuthology.orchestra.run.smithi035:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-01-25T09:29:47.659 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-137-generic 2023-01-25T09:29:47.659 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-grub 2023-01-25T09:29:47.695 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:29:47.696 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-01-25T09:29:47.696 DEBUG:teuthology.orchestra.run.smithi035:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-01-25T09:29:47.727 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-137-generic 2023-01-25T09:29:47.728 DEBUG:teuthology.orchestra.run.smithi035:> sudo update-grub 2023-01-25T09:29:49.037 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2023-01-25T09:29:49.048 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-25T09:29:49.059 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2023-01-25T09:29:49.059 INFO:teuthology.orchestra.run.smithi035.stderr:Sourcing file `/etc/default/grub' 2023-01-25T09:29:49.069 INFO:teuthology.orchestra.run.smithi035.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-25T09:29:49.077 INFO:teuthology.orchestra.run.smithi035.stderr:Generating grub configuration file ... 2023-01-25T09:29:49.365 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-25T09:29:49.376 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-25T09:29:49.385 INFO:teuthology.orchestra.run.smithi035.stderr:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-25T09:29:49.397 INFO:teuthology.orchestra.run.smithi035.stderr:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-25T09:29:49.826 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-25T09:29:49.838 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-25T09:29:49.838 INFO:teuthology.orchestra.run.smithi035.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-25T09:29:49.850 INFO:teuthology.orchestra.run.smithi035.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-25T09:29:51.340 INFO:teuthology.orchestra.run.smithi035.stderr:done 2023-01-25T09:29:51.342 DEBUG:teuthology.orchestra.run.smithi035:> sudo shutdown -r now 2023-01-25T09:29:51.535 INFO:teuthology.orchestra.run.smithi138.stderr:done 2023-01-25T09:29:51.537 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2023-01-25T09:30:21.372 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-01-25T09:30:21.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-01-25T09:30:21.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:30:21.540 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-01-25T09:30:21.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-01-25T09:30:21.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:30:40.108 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-01-25T09:31:10.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-01-25T09:31:10.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:31:21.384 DEBUG:teuthology.orchestra.remote:timed out 2023-01-25T09:31:28.492 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-01-25T09:31:51.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-01-25T09:31:51.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:31:51.619 DEBUG:teuthology.orchestra.run.smithi035:> true 2023-01-25T09:31:52.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-01-25T09:31:52.233 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-137-generic"... 2023-01-25T09:31:52.234 DEBUG:teuthology.orchestra.run.smithi035:> uname -r 2023-01-25T09:31:52.240 INFO:teuthology.orchestra.run.smithi035.stdout:5.4.0-137-generic 2023-01-25T09:31:52.241 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-137-generic vs 5.4.0-137-generic 2023-01-25T09:31:52.241 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T09:31:52.241 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-01-25T09:31:53.242 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-01-25T09:31:53.243 DEBUG:teuthology.orchestra.run.smithi035:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T09:31:53.329 INFO:teuthology.orchestra.run.smithi035.stdout:ttyS1 2023-01-25T09:31:53.363 DEBUG:teuthology.parallel:result is None 2023-01-25T09:31:58.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-01-25T09:31:58.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:31:58.705 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-01-25T09:31:59.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-01-25T09:31:59.296 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-137-generic"... 2023-01-25T09:31:59.296 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2023-01-25T09:31:59.343 INFO:teuthology.orchestra.run.smithi138.stdout:5.4.0-137-generic 2023-01-25T09:31:59.343 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-137-generic vs 5.4.0-137-generic 2023-01-25T09:31:59.344 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T09:31:59.344 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-01-25T09:32:00.345 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-01-25T09:32:00.345 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T09:32:00.452 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2023-01-25T09:32:00.479 DEBUG:teuthology.parallel:result is None 2023-01-25T09:32:00.480 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-25T09:32:00.488 INFO:teuthology.task.internal:Creating test directory... 2023-01-25T09:32:00.489 DEBUG:teuthology.orchestra.run.smithi035:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T09:32:00.491 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T09:32:00.500 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-25T09:32:00.508 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-25T09:32:00.533 INFO:teuthology.task.internal:Creating archive directory... 2023-01-25T09:32:00.534 DEBUG:teuthology.orchestra.run.smithi035:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T09:32:00.542 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T09:32:00.568 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-25T09:32:00.574 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-25T09:32:00.575 DEBUG:teuthology.orchestra.run.smithi035:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T09:32:00.577 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T09:32:00.595 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T09:32:00.596 INFO:teuthology.orchestra.run.smithi035.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T09:32:00.603 INFO:teuthology.orchestra.run.smithi035.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T09:32:00.606 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T09:32:00.608 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-25T09:32:00.617 INFO:teuthology.task.internal:Configuring sudo... 2023-01-25T09:32:00.618 DEBUG:teuthology.orchestra.run.smithi035:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T09:32:00.646 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T09:32:00.662 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-25T09:32:00.672 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-25T09:32:00.673 DEBUG:teuthology.orchestra.run.smithi035:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T09:32:00.675 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T09:32:00.711 DEBUG:teuthology.orchestra.run.smithi035:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T09:32:00.718 DEBUG:teuthology.orchestra.run.smithi035:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T09:32:00.767 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:32:00.767 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T09:32:00.784 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T09:32:00.792 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T09:32:00.798 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:32:00.799 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T09:32:00.877 DEBUG:teuthology.orchestra.run.smithi035:> sudo service rsyslog restart 2023-01-25T09:32:00.879 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2023-01-25T09:32:00.936 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-25T09:32:00.943 INFO:teuthology.task.internal:Starting timer... 2023-01-25T09:32:00.944 INFO:teuthology.run_tasks:Running task pcp... 2023-01-25T09:32:00.961 INFO:teuthology.run_tasks:Running task selinux... 2023-01-25T09:32:00.969 DEBUG:teuthology.task.selinux:Excluding smithi035: OS 'ubuntu' does not support SELinux 2023-01-25T09:32:00.970 DEBUG:teuthology.task.selinux:Excluding smithi138: OS 'ubuntu' does not support SELinux 2023-01-25T09:32:00.970 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-25T09:32:00.970 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-01-25T09:32:00.971 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-25T09:32:00.971 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-25T09:32:00.979 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-01-25T09:32:00.980 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-25T09:32:00.996 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-25T09:32:00.998 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi035.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-25T09:36:46.590 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi035.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2023-01-25T09:36:46.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi035.front.sepia.ceph.com' 2023-01-25T09:36:46.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi035.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:36:46.643 DEBUG:teuthology.orchestra.run.smithi035:> true 2023-01-25T09:36:46.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-01-25T09:36:46.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:36:46.815 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-01-25T09:36:46.942 INFO:teuthology.run_tasks:Running task clock... 2023-01-25T09:36:46.953 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-25T09:36:46.954 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T09:36:46.955 DEBUG:teuthology.orchestra.run.smithi035:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T09:36:46.957 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T09:36:46.957 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T09:36:46.991 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:46 ntpd[19324]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-01-25T09:36:46.991 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:46 ntpd[19324]: Command line: ntpd -gq 2023-01-25T09:36:46.992 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:46 ntpd[19475]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-01-25T09:36:46.992 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:46 ntpd[19475]: Command line: ntpd -gq 2023-01-25T09:36:46.993 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:46 ntpd[19324]: proto: precision = 0.072 usec (-24) 2023-01-25T09:36:46.993 INFO:teuthology.orchestra.run.smithi035.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-25T09:36:46.994 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:46 ntpd[19324]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-25T09:36:46.994 INFO:teuthology.orchestra.run.smithi035.stderr:restrict ::: KOD does nothing without LIMITED. 2023-01-25T09:36:46.995 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:46 ntpd[19324]: restrict ::: KOD does nothing without LIMITED. 2023-01-25T09:36:46.995 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:46 ntpd[19324]: Listen and drop on 0 v6wildcard [::]:123 2023-01-25T09:36:46.995 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:46 ntpd[19324]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-01-25T09:36:46.996 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:46 ntpd[19324]: Listen normally on 2 lo 127.0.0.1:123 2023-01-25T09:36:46.996 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:46 ntpd[19324]: Listen normally on 3 ens1f0 172.21.15.35:123 2023-01-25T09:36:46.996 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:46 ntpd[19324]: Listen normally on 4 lo [::1]:123 2023-01-25T09:36:46.996 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:46 ntpd[19324]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:25f6%4]:123 2023-01-25T09:36:46.997 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:46 ntpd[19324]: Listening on routing socket on fd #22 for interface updates 2023-01-25T09:36:46.997 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:46 ntpd[19475]: proto: precision = 0.257 usec (-22) 2023-01-25T09:36:46.997 INFO:teuthology.orchestra.run.smithi138.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-25T09:36:46.998 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:46 ntpd[19475]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-25T09:36:46.998 INFO:teuthology.orchestra.run.smithi138.stderr:restrict ::: KOD does nothing without LIMITED. 2023-01-25T09:36:46.999 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:46 ntpd[19475]: restrict ::: KOD does nothing without LIMITED. 2023-01-25T09:36:46.999 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:46 ntpd[19475]: Listen and drop on 0 v6wildcard [::]:123 2023-01-25T09:36:47.000 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:46 ntpd[19475]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-01-25T09:36:47.000 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:46 ntpd[19475]: Listen normally on 2 lo 127.0.0.1:123 2023-01-25T09:36:47.000 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:46 ntpd[19475]: Listen normally on 3 enp3s0f1 172.21.15.138:123 2023-01-25T09:36:47.000 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:46 ntpd[19475]: Listen normally on 4 lo [::1]:123 2023-01-25T09:36:47.001 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:46 ntpd[19475]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f71%5]:123 2023-01-25T09:36:47.001 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:46 ntpd[19475]: Listening on routing socket on fd #22 for interface updates 2023-01-25T09:36:47.993 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:47.993 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:47.993 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:47.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:47.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:47.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:47.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:47.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:47.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:47.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:47.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:47.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:47.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:47.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:47 ntpd[19324]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:47.996 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:47 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:47 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:47 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:47.997 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:47 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:47 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:47 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:47 ntpd[19475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:47.998 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:47 ntpd[19475]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:48.992 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:48 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:48.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:48 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:48.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:48 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:48.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:48 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:48.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:48 ntpd[19475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:48.994 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:48 ntpd[19475]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:49.993 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:49.993 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:49.993 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:49.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:49.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:49.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:49.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:49.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:49.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:49.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:49.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:49.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:49.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:49.996 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:49.996 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:49.996 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:49.996 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:49.996 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:49 ntpd[19324]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:49.998 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:49 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:49.998 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:49 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:49.998 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:49 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:49.998 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:49 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:49.999 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:49 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:49.999 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:49 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:49.999 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:49 ntpd[19475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:49.999 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:49 ntpd[19475]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:49.999 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:49 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:50.000 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:49 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:50.000 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:49 ntpd[19475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:50.000 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:49 ntpd[19475]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:50.992 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:50 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:50.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:50 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:50.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:50 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:50.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:50 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:50.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:50 ntpd[19475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:50.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:50 ntpd[19475]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:51.993 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:51.993 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:51.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:51.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:51.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:51.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:51.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:51.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:51.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:51.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:51.996 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:51.996 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:51.996 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:51.996 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:51.996 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:51.997 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:51.997 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:51.997 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:51 ntpd[19324]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:51 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:51 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:51 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:51 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:51 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:51 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:51 ntpd[19475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:51 ntpd[19475]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:51 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:52.000 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:51 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:52.001 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:51 ntpd[19475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:52.001 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:51 ntpd[19475]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:52.992 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:52 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:52.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:52 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:52.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:52 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:52.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:52 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:52.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:52 ntpd[19475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:52.993 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:52 ntpd[19475]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:53.993 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:53.993 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:53.993 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:53.993 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:53.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:53.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:53.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:53.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:53.994 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:53.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:53.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:53.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:53.995 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:53.996 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:53.996 INFO:teuthology.orchestra.run.smithi035.stdout:25 Jan 09:36:53 ntpd[19324]: ntpd: time slew +0.000168 s 2023-01-25T09:36:53.997 INFO:teuthology.orchestra.run.smithi035.stdout:ntpd: time slew +0.000168s 2023-01-25T09:36:53.997 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-01-25T09:36:53.997 INFO:teuthology.orchestra.run.smithi035.stderr:25 Jan 09:36:53 ntpd[19324]: can't open /var/log/ntpstats/loopstats.20230125: Permission denied 2023-01-25T09:36:53.999 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:53.999 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:53.999 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:54.000 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-25T09:36:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: can't open /var/log/ntpstats/rawstats.20230125: Permission denied 2023-01-25T09:36:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-25T09:36:54.001 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: can't open /var/log/ntpstats/peerstats.20230125: Permission denied 2023-01-25T09:36:54.002 INFO:teuthology.orchestra.run.smithi138.stdout:25 Jan 09:36:53 ntpd[19475]: ntpd: time slew +0.000605 s 2023-01-25T09:36:54.002 INFO:teuthology.orchestra.run.smithi138.stdout:ntpd: time slew +0.000605s 2023-01-25T09:36:54.002 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-01-25T09:36:54.003 INFO:teuthology.orchestra.run.smithi138.stderr:25 Jan 09:36:53 ntpd[19475]: can't open /var/log/ntpstats/loopstats.20230125: Permission denied 2023-01-25T09:36:54.063 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2023-01-25T09:36:54.063 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2023-01-25T09:36:54.064 INFO:teuthology.orchestra.run.smithi138.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:36:54.064 INFO:teuthology.orchestra.run.smithi138.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:36:54.064 INFO:teuthology.orchestra.run.smithi138.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:36:54.064 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:36:54.066 INFO:teuthology.orchestra.run.smithi035.stdout: remote refid st t when poll reach delay offset jitter 2023-01-25T09:36:54.066 INFO:teuthology.orchestra.run.smithi035.stdout:============================================================================== 2023-01-25T09:36:54.066 INFO:teuthology.orchestra.run.smithi035.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:36:54.066 INFO:teuthology.orchestra.run.smithi035.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:36:54.067 INFO:teuthology.orchestra.run.smithi035.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:36:54.067 INFO:teuthology.orchestra.run.smithi035.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-25T09:36:54.067 INFO:teuthology.run_tasks:Running task install... 2023-01-25T09:36:54.076 DEBUG:teuthology.task.install:project ceph 2023-01-25T09:36:54.076 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}} 2023-01-25T09:36:54.077 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'} 2023-01-25T09:36:54.077 INFO:teuthology.task.install:Using flavor: default 2023-01-25T09:36:54.084 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-25T09:36:54.084 INFO:teuthology.task.install:extra packages: [] 2023-01-25T09:36:54.085 DEBUG:teuthology.orchestra.run.smithi035:> sudo lsb_release -is 2023-01-25T09:36:54.160 INFO:teuthology.orchestra.run.smithi035.stdout:Ubuntu 2023-01-25T09:36:54.165 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T09:36:54.166 DEBUG:teuthology.orchestra.run.smithi138:> sudo lsb_release -is 2023-01-25T09:36:54.166 DEBUG:teuthology.orchestra.run.smithi035:> sudo apt-key list | grep Ceph 2023-01-25T09:36:54.217 INFO:teuthology.orchestra.run.smithi138.stdout:Ubuntu 2023-01-25T09:36:54.224 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T09:36:54.224 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-key list | grep Ceph 2023-01-25T09:36:54.266 INFO:teuthology.orchestra.run.smithi035.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-01-25T09:36:54.325 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-01-25T09:36:54.331 INFO:teuthology.orchestra.run.smithi035.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-01-25T09:36:54.331 INFO:teuthology.orchestra.run.smithi035.stdout:uid [ unknown] Ceph.com (release key) 2023-01-25T09:36:54.332 DEBUG:teuthology.orchestra.run.smithi035:> sudo lsb_release -is 2023-01-25T09:36:54.379 INFO:teuthology.orchestra.run.smithi035.stdout:Ubuntu 2023-01-25T09:36:54.384 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T09:36:54.385 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-01-25T09:36:54.385 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:36:54.391 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-01-25T09:36:54.391 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph.com (release key) 2023-01-25T09:36:54.392 DEBUG:teuthology.orchestra.run.smithi138:> sudo lsb_release -is 2023-01-25T09:36:54.442 INFO:teuthology.orchestra.run.smithi138.stdout:Ubuntu 2023-01-25T09:36:54.448 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T09:36:54.448 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-01-25T09:36:54.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:36:54.551 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default/ 2023-01-25T09:36:54.551 INFO:teuthology.task.install.deb:Package version is 18.0.0-1986-g44e4095d-1focal 2023-01-25T09:36:54.631 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default/ 2023-01-25T09:36:54.631 INFO:teuthology.task.install.deb:Package version is 18.0.0-1986-g44e4095d-1focal 2023-01-25T09:36:54.804 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:36:54.805 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-01-25T09:36:54.822 DEBUG:teuthology.orchestra.run.smithi035:> sudo apt-get update 2023-01-25T09:36:54.856 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:36:54.856 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-01-25T09:36:54.873 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2023-01-25T09:36:55.051 INFO:teuthology.orchestra.run.smithi035.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal InRelease 2023-01-25T09:36:55.091 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal InRelease 2023-01-25T09:36:55.092 INFO:teuthology.orchestra.run.smithi035.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-01-25T09:36:55.112 INFO:teuthology.orchestra.run.smithi035.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T09:36:55.112 INFO:teuthology.orchestra.run.smithi035.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-25T09:36:55.127 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-01-25T09:36:55.130 INFO:teuthology.orchestra.run.smithi035.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal Release.gpg 2023-01-25T09:36:55.159 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-25T09:36:55.159 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-25T09:36:55.180 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal Release.gpg 2023-01-25T09:36:55.181 INFO:teuthology.orchestra.run.smithi035.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-01-25T09:36:55.205 INFO:teuthology.orchestra.run.smithi035.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-25T09:36:55.238 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-25T09:36:55.241 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-01-25T09:36:55.270 INFO:teuthology.orchestra.run.smithi035.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main i386 Packages [3,420 B] 2023-01-25T09:36:55.284 INFO:teuthology.orchestra.run.smithi035.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-25T09:36:55.318 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main i386 Packages [3,420 B] 2023-01-25T09:36:55.330 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-25T09:36:55.799 INFO:teuthology.orchestra.run.smithi035.stdout:Fetched 28.4 kB in 1s (34.9 kB/s) 2023-01-25T09:36:55.802 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 28.4 kB in 1s (36.9 kB/s) 2023-01-25T09:36:56.739 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-01-25T09:36:56.763 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-1986-g44e4095d-1focal cephadm=18.0.0-1986-g44e4095d-1focal ceph-mds=18.0.0-1986-g44e4095d-1focal ceph-mgr=18.0.0-1986-g44e4095d-1focal ceph-common=18.0.0-1986-g44e4095d-1focal ceph-fuse=18.0.0-1986-g44e4095d-1focal ceph-test=18.0.0-1986-g44e4095d-1focal ceph-volume=18.0.0-1986-g44e4095d-1focal radosgw=18.0.0-1986-g44e4095d-1focal python3-rados=18.0.0-1986-g44e4095d-1focal python3-rgw=18.0.0-1986-g44e4095d-1focal python3-cephfs=18.0.0-1986-g44e4095d-1focal python3-rbd=18.0.0-1986-g44e4095d-1focal libcephfs2=18.0.0-1986-g44e4095d-1focal libcephfs-dev=18.0.0-1986-g44e4095d-1focal librados2=18.0.0-1986-g44e4095d-1focal librbd1=18.0.0-1986-g44e4095d-1focal rbd-fuse=18.0.0-1986-g44e4095d-1focal 2023-01-25T09:36:56.782 INFO:teuthology.orchestra.run.smithi035.stdout:Reading package lists... 2023-01-25T09:36:56.806 DEBUG:teuthology.orchestra.run.smithi035:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-1986-g44e4095d-1focal cephadm=18.0.0-1986-g44e4095d-1focal ceph-mds=18.0.0-1986-g44e4095d-1focal ceph-mgr=18.0.0-1986-g44e4095d-1focal ceph-common=18.0.0-1986-g44e4095d-1focal ceph-fuse=18.0.0-1986-g44e4095d-1focal ceph-test=18.0.0-1986-g44e4095d-1focal ceph-volume=18.0.0-1986-g44e4095d-1focal radosgw=18.0.0-1986-g44e4095d-1focal python3-rados=18.0.0-1986-g44e4095d-1focal python3-rgw=18.0.0-1986-g44e4095d-1focal python3-cephfs=18.0.0-1986-g44e4095d-1focal python3-rbd=18.0.0-1986-g44e4095d-1focal libcephfs2=18.0.0-1986-g44e4095d-1focal libcephfs-dev=18.0.0-1986-g44e4095d-1focal librados2=18.0.0-1986-g44e4095d-1focal librbd1=18.0.0-1986-g44e4095d-1focal rbd-fuse=18.0.0-1986-g44e4095d-1focal 2023-01-25T09:36:56.835 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-01-25T09:36:56.876 INFO:teuthology.orchestra.run.smithi035.stdout:Reading package lists... 2023-01-25T09:36:56.999 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2023-01-25T09:36:57.000 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2023-01-25T09:36:57.067 INFO:teuthology.orchestra.run.smithi035.stdout:Building dependency tree... 2023-01-25T09:36:57.068 INFO:teuthology.orchestra.run.smithi035.stdout:Reading state information... 2023-01-25T09:36:57.155 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2023-01-25T09:36:57.156 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-01-25T09:36:57.156 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2023-01-25T09:36:57.156 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2023-01-25T09:36:57.156 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-01-25T09:36:57.157 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-01-25T09:36:57.157 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-01-25T09:36:57.157 INFO:teuthology.orchestra.run.smithi138.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-01-25T09:36:57.157 INFO:teuthology.orchestra.run.smithi138.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-01-25T09:36:57.158 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-01-25T09:36:57.158 INFO:teuthology.orchestra.run.smithi138.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-01-25T09:36:57.158 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-01-25T09:36:57.159 INFO:teuthology.orchestra.run.smithi138.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-01-25T09:36:57.159 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-01-25T09:36:57.159 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-01-25T09:36:57.159 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-01-25T09:36:57.159 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-01-25T09:36:57.160 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-01-25T09:36:57.160 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-01-25T09:36:57.160 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-01-25T09:36:57.160 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-01-25T09:36:57.160 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-01-25T09:36:57.161 INFO:teuthology.orchestra.run.smithi138.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-01-25T09:36:57.161 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-01-25T09:36:57.161 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-01-25T09:36:57.161 INFO:teuthology.orchestra.run.smithi138.stdout: qttranslations5-l10n socat xmlstarlet 2023-01-25T09:36:57.161 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2023-01-25T09:36:57.162 INFO:teuthology.orchestra.run.smithi138.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-01-25T09:36:57.162 INFO:teuthology.orchestra.run.smithi138.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-01-25T09:36:57.162 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-01-25T09:36:57.162 INFO:teuthology.orchestra.run.smithi138.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-01-25T09:36:57.162 INFO:teuthology.orchestra.run.smithi138.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-01-25T09:36:57.163 INFO:teuthology.orchestra.run.smithi138.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-01-25T09:36:57.163 INFO:teuthology.orchestra.run.smithi138.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-01-25T09:36:57.163 INFO:teuthology.orchestra.run.smithi138.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-01-25T09:36:57.163 INFO:teuthology.orchestra.run.smithi138.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-01-25T09:36:57.163 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2023-01-25T09:36:57.163 INFO:teuthology.orchestra.run.smithi138.stdout: btrfs-tools 2023-01-25T09:36:57.245 INFO:teuthology.orchestra.run.smithi035.stdout:The following packages were automatically installed and are no longer required: 2023-01-25T09:36:57.246 INFO:teuthology.orchestra.run.smithi035.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-01-25T09:36:57.247 INFO:teuthology.orchestra.run.smithi035.stdout:Use 'sudo apt autoremove' to remove them. 2023-01-25T09:36:57.247 INFO:teuthology.orchestra.run.smithi035.stdout:The following additional packages will be installed: 2023-01-25T09:36:57.247 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-01-25T09:36:57.247 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-01-25T09:36:57.247 INFO:teuthology.orchestra.run.smithi035.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-01-25T09:36:57.248 INFO:teuthology.orchestra.run.smithi035.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-01-25T09:36:57.248 INFO:teuthology.orchestra.run.smithi035.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-01-25T09:36:57.248 INFO:teuthology.orchestra.run.smithi035.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-01-25T09:36:57.248 INFO:teuthology.orchestra.run.smithi035.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-01-25T09:36:57.248 INFO:teuthology.orchestra.run.smithi035.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-01-25T09:36:57.249 INFO:teuthology.orchestra.run.smithi035.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-01-25T09:36:57.249 INFO:teuthology.orchestra.run.smithi035.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-01-25T09:36:57.249 INFO:teuthology.orchestra.run.smithi035.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-01-25T09:36:57.249 INFO:teuthology.orchestra.run.smithi035.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-01-25T09:36:57.249 INFO:teuthology.orchestra.run.smithi035.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-01-25T09:36:57.250 INFO:teuthology.orchestra.run.smithi035.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-01-25T09:36:57.250 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-01-25T09:36:57.250 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-01-25T09:36:57.250 INFO:teuthology.orchestra.run.smithi035.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-01-25T09:36:57.250 INFO:teuthology.orchestra.run.smithi035.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-01-25T09:36:57.251 INFO:teuthology.orchestra.run.smithi035.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-01-25T09:36:57.251 INFO:teuthology.orchestra.run.smithi035.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-01-25T09:36:57.251 INFO:teuthology.orchestra.run.smithi035.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-01-25T09:36:57.251 INFO:teuthology.orchestra.run.smithi035.stdout: qttranslations5-l10n socat xmlstarlet 2023-01-25T09:36:57.252 INFO:teuthology.orchestra.run.smithi035.stdout:Suggested packages: 2023-01-25T09:36:57.252 INFO:teuthology.orchestra.run.smithi035.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-01-25T09:36:57.252 INFO:teuthology.orchestra.run.smithi035.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-01-25T09:36:57.252 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-01-25T09:36:57.252 INFO:teuthology.orchestra.run.smithi035.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-01-25T09:36:57.253 INFO:teuthology.orchestra.run.smithi035.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-01-25T09:36:57.253 INFO:teuthology.orchestra.run.smithi035.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-01-25T09:36:57.253 INFO:teuthology.orchestra.run.smithi035.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-01-25T09:36:57.253 INFO:teuthology.orchestra.run.smithi035.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-01-25T09:36:57.253 INFO:teuthology.orchestra.run.smithi035.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-01-25T09:36:57.254 INFO:teuthology.orchestra.run.smithi035.stdout:Recommended packages: 2023-01-25T09:36:57.254 INFO:teuthology.orchestra.run.smithi035.stdout: btrfs-tools 2023-01-25T09:36:57.268 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2023-01-25T09:36:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-01-25T09:36:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-01-25T09:36:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-01-25T09:36:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-01-25T09:36:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-01-25T09:36:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-01-25T09:36:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-01-25T09:36:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-01-25T09:36:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-01-25T09:36:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-01-25T09:36:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-01-25T09:36:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-01-25T09:36:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-01-25T09:36:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-01-25T09:36:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-01-25T09:36:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-01-25T09:36:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-01-25T09:36:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-01-25T09:36:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-01-25T09:36:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-01-25T09:36:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-01-25T09:36:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-01-25T09:36:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-01-25T09:36:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-01-25T09:36:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet 2023-01-25T09:36:57.274 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2023-01-25T09:36:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: librados2 librbd1 2023-01-25T09:36:57.363 INFO:teuthology.orchestra.run.smithi035.stdout:The following NEW packages will be installed: 2023-01-25T09:36:57.364 INFO:teuthology.orchestra.run.smithi035.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-01-25T09:36:57.364 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-01-25T09:36:57.364 INFO:teuthology.orchestra.run.smithi035.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-01-25T09:36:57.365 INFO:teuthology.orchestra.run.smithi035.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-01-25T09:36:57.365 INFO:teuthology.orchestra.run.smithi035.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-01-25T09:36:57.365 INFO:teuthology.orchestra.run.smithi035.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-01-25T09:36:57.366 INFO:teuthology.orchestra.run.smithi035.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-01-25T09:36:57.367 INFO:teuthology.orchestra.run.smithi035.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-01-25T09:36:57.367 INFO:teuthology.orchestra.run.smithi035.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-01-25T09:36:57.367 INFO:teuthology.orchestra.run.smithi035.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-01-25T09:36:57.367 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-01-25T09:36:57.367 INFO:teuthology.orchestra.run.smithi035.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-01-25T09:36:57.368 INFO:teuthology.orchestra.run.smithi035.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-01-25T09:36:57.368 INFO:teuthology.orchestra.run.smithi035.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-01-25T09:36:57.368 INFO:teuthology.orchestra.run.smithi035.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-01-25T09:36:57.368 INFO:teuthology.orchestra.run.smithi035.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-01-25T09:36:57.368 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-01-25T09:36:57.369 INFO:teuthology.orchestra.run.smithi035.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-01-25T09:36:57.369 INFO:teuthology.orchestra.run.smithi035.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-01-25T09:36:57.369 INFO:teuthology.orchestra.run.smithi035.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-01-25T09:36:57.370 INFO:teuthology.orchestra.run.smithi035.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-01-25T09:36:57.370 INFO:teuthology.orchestra.run.smithi035.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-01-25T09:36:57.370 INFO:teuthology.orchestra.run.smithi035.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-01-25T09:36:57.370 INFO:teuthology.orchestra.run.smithi035.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-01-25T09:36:57.370 INFO:teuthology.orchestra.run.smithi035.stdout: xmlstarlet 2023-01-25T09:36:57.371 INFO:teuthology.orchestra.run.smithi035.stdout:The following packages will be upgraded: 2023-01-25T09:36:57.371 INFO:teuthology.orchestra.run.smithi035.stdout: librados2 librbd1 2023-01-25T09:36:57.467 INFO:teuthology.orchestra.run.smithi138.stdout:2 upgraded, 110 newly installed, 0 to remove and 124 not upgraded. 2023-01-25T09:36:57.468 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 199 MB of archives. 2023-01-25T09:36:57.468 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 975 MB of additional disk space will be used. 2023-01-25T09:36:57.468 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-1986-g44e4095d-1focal [3,428 kB] 2023-01-25T09:36:57.482 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-01-25T09:36:57.578 INFO:teuthology.orchestra.run.smithi035.stdout:2 upgraded, 110 newly installed, 0 to remove and 124 not upgraded. 2023-01-25T09:36:57.579 INFO:teuthology.orchestra.run.smithi035.stdout:Need to get 199 MB of archives. 2023-01-25T09:36:57.579 INFO:teuthology.orchestra.run.smithi035.stdout:After this operation, 975 MB of additional disk space will be used. 2023-01-25T09:36:57.579 INFO:teuthology.orchestra.run.smithi035.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-01-25T09:36:57.628 INFO:teuthology.orchestra.run.smithi035.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-1986-g44e4095d-1focal [3,428 kB] 2023-01-25T09:36:57.929 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-01-25T09:36:57.944 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-01-25T09:36:58.024 INFO:teuthology.orchestra.run.smithi035.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-01-25T09:36:58.039 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-01-25T09:36:58.040 INFO:teuthology.orchestra.run.smithi035.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-01-25T09:36:58.134 INFO:teuthology.orchestra.run.smithi035.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-01-25T09:36:58.280 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-1986-g44e4095d-1focal [3,962 kB] 2023-01-25T09:36:58.312 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-01-25T09:36:58.323 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-01-25T09:36:58.355 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-01-25T09:36:58.366 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-01-25T09:36:58.366 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-01-25T09:36:58.370 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-01-25T09:36:58.371 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-01-25T09:36:58.386 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-01-25T09:36:58.386 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-01-25T09:36:58.404 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-01-25T09:36:58.411 INFO:teuthology.orchestra.run.smithi035.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-01-25T09:36:58.419 INFO:teuthology.orchestra.run.smithi035.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-01-25T09:36:58.451 INFO:teuthology.orchestra.run.smithi035.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-01-25T09:36:58.461 INFO:teuthology.orchestra.run.smithi035.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-01-25T09:36:58.462 INFO:teuthology.orchestra.run.smithi035.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-01-25T09:36:58.465 INFO:teuthology.orchestra.run.smithi035.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-01-25T09:36:58.467 INFO:teuthology.orchestra.run.smithi035.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-01-25T09:36:58.481 INFO:teuthology.orchestra.run.smithi035.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-01-25T09:36:58.482 INFO:teuthology.orchestra.run.smithi035.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-01-25T09:36:58.484 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-01-25T09:36:58.484 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-01-25T09:36:58.485 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-01-25T09:36:58.487 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-01-25T09:36:58.488 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-01-25T09:36:58.488 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-01-25T09:36:58.490 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-01-25T09:36:58.492 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-01-25T09:36:58.495 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-01-25T09:36:58.500 INFO:teuthology.orchestra.run.smithi035.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-01-25T09:36:58.556 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-1986-g44e4095d-1focal [720 kB] 2023-01-25T09:36:58.570 INFO:teuthology.orchestra.run.smithi035.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-1986-g44e4095d-1focal [3,962 kB] 2023-01-25T09:36:58.579 INFO:teuthology.orchestra.run.smithi035.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-01-25T09:36:58.580 INFO:teuthology.orchestra.run.smithi035.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-01-25T09:36:58.580 INFO:teuthology.orchestra.run.smithi035.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-01-25T09:36:58.582 INFO:teuthology.orchestra.run.smithi035.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-01-25T09:36:58.583 INFO:teuthology.orchestra.run.smithi035.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-01-25T09:36:58.584 INFO:teuthology.orchestra.run.smithi035.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-01-25T09:36:58.586 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-01-25T09:36:58.586 INFO:teuthology.orchestra.run.smithi035.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-01-25T09:36:58.587 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-01-25T09:36:58.587 INFO:teuthology.orchestra.run.smithi035.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-01-25T09:36:58.591 INFO:teuthology.orchestra.run.smithi035.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-01-25T09:36:58.593 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-01-25T09:36:58.593 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-01-25T09:36:58.594 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-01-25T09:36:58.595 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-01-25T09:36:58.596 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2023-01-25T09:36:58.599 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-01-25T09:36:58.602 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-01-25T09:36:58.610 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-1986-g44e4095d-1focal [376 kB] 2023-01-25T09:36:58.636 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-1986-g44e4095d-1focal [22.4 kB] 2023-01-25T09:36:58.637 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-1986-g44e4095d-1focal [184 kB] 2023-01-25T09:36:58.641 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-1986-g44e4095d-1focal [46.5 kB] 2023-01-25T09:36:58.643 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-1986-g44e4095d-1focal [354 kB] 2023-01-25T09:36:58.662 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-1986-g44e4095d-1focal [6,521 kB] 2023-01-25T09:36:58.680 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-01-25T09:36:58.681 INFO:teuthology.orchestra.run.smithi035.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-01-25T09:36:58.682 INFO:teuthology.orchestra.run.smithi035.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-01-25T09:36:58.683 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-01-25T09:36:58.691 INFO:teuthology.orchestra.run.smithi035.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-01-25T09:36:58.692 INFO:teuthology.orchestra.run.smithi035.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-01-25T09:36:58.693 INFO:teuthology.orchestra.run.smithi035.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-01-25T09:36:58.694 INFO:teuthology.orchestra.run.smithi035.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-01-25T09:36:58.696 INFO:teuthology.orchestra.run.smithi035.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2023-01-25T09:36:58.698 INFO:teuthology.orchestra.run.smithi035.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-01-25T09:36:58.700 INFO:teuthology.orchestra.run.smithi035.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-01-25T09:36:58.772 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-01-25T09:36:58.773 INFO:teuthology.orchestra.run.smithi138.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-01-25T09:36:58.774 INFO:teuthology.orchestra.run.smithi138.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-01-25T09:36:58.775 INFO:teuthology.orchestra.run.smithi138.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-01-25T09:36:58.775 INFO:teuthology.orchestra.run.smithi138.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-01-25T09:36:58.777 INFO:teuthology.orchestra.run.smithi035.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-01-25T09:36:58.778 INFO:teuthology.orchestra.run.smithi138.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-01-25T09:36:58.778 INFO:teuthology.orchestra.run.smithi138.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-01-25T09:36:58.779 INFO:teuthology.orchestra.run.smithi138.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-01-25T09:36:58.780 INFO:teuthology.orchestra.run.smithi035.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-01-25T09:36:58.863 INFO:teuthology.orchestra.run.smithi138.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-01-25T09:36:58.866 INFO:teuthology.orchestra.run.smithi138.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-01-25T09:36:58.868 INFO:teuthology.orchestra.run.smithi035.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-01-25T09:36:58.870 INFO:teuthology.orchestra.run.smithi035.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-01-25T09:36:58.871 INFO:teuthology.orchestra.run.smithi035.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-01-25T09:36:58.872 INFO:teuthology.orchestra.run.smithi035.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-01-25T09:36:58.873 INFO:teuthology.orchestra.run.smithi035.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-01-25T09:36:58.875 INFO:teuthology.orchestra.run.smithi035.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-01-25T09:36:58.876 INFO:teuthology.orchestra.run.smithi035.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-01-25T09:36:58.877 INFO:teuthology.orchestra.run.smithi035.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-01-25T09:36:58.955 INFO:teuthology.orchestra.run.smithi138.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-01-25T09:36:58.958 INFO:teuthology.orchestra.run.smithi138.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-01-25T09:36:58.960 INFO:teuthology.orchestra.run.smithi138.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-01-25T09:36:58.961 INFO:teuthology.orchestra.run.smithi035.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-01-25T09:36:58.962 INFO:teuthology.orchestra.run.smithi138.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-01-25T09:36:58.962 INFO:teuthology.orchestra.run.smithi138.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-01-25T09:36:58.964 INFO:teuthology.orchestra.run.smithi138.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-01-25T09:36:58.964 INFO:teuthology.orchestra.run.smithi035.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-01-25T09:36:58.976 INFO:teuthology.orchestra.run.smithi138.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-1986-g44e4095d-1focal [104 kB] 2023-01-25T09:36:58.980 INFO:teuthology.orchestra.run.smithi138.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-1986-g44e4095d-1focal [467 kB] 2023-01-25T09:36:58.990 INFO:teuthology.orchestra.run.smithi035.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-1986-g44e4095d-1focal [720 kB] 2023-01-25T09:36:59.007 INFO:teuthology.orchestra.run.smithi138.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-1986-g44e4095d-1focal [24.9 MB] 2023-01-25T09:36:59.047 INFO:teuthology.orchestra.run.smithi035.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-1986-g44e4095d-1focal [376 kB] 2023-01-25T09:36:59.055 INFO:teuthology.orchestra.run.smithi035.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-01-25T09:36:59.058 INFO:teuthology.orchestra.run.smithi035.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-01-25T09:36:59.060 INFO:teuthology.orchestra.run.smithi035.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-01-25T09:36:59.062 INFO:teuthology.orchestra.run.smithi035.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-01-25T09:36:59.063 INFO:teuthology.orchestra.run.smithi035.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-01-25T09:36:59.064 INFO:teuthology.orchestra.run.smithi035.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-01-25T09:36:59.095 INFO:teuthology.orchestra.run.smithi035.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-1986-g44e4095d-1focal [22.4 kB] 2023-01-25T09:36:59.096 INFO:teuthology.orchestra.run.smithi035.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-1986-g44e4095d-1focal [184 kB] 2023-01-25T09:36:59.131 INFO:teuthology.orchestra.run.smithi035.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-1986-g44e4095d-1focal [46.5 kB] 2023-01-25T09:36:59.133 INFO:teuthology.orchestra.run.smithi035.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-1986-g44e4095d-1focal [354 kB] 2023-01-25T09:36:59.155 INFO:teuthology.orchestra.run.smithi035.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-1986-g44e4095d-1focal [6,521 kB] 2023-01-25T09:36:59.271 INFO:teuthology.orchestra.run.smithi138.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-01-25T09:36:59.356 INFO:teuthology.orchestra.run.smithi138.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-01-25T09:36:59.359 INFO:teuthology.orchestra.run.smithi138.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-01-25T09:36:59.419 INFO:teuthology.orchestra.run.smithi138.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-01-25T09:36:59.419 INFO:teuthology.orchestra.run.smithi138.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-01-25T09:36:59.422 INFO:teuthology.orchestra.run.smithi035.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-01-25T09:36:59.423 INFO:teuthology.orchestra.run.smithi138.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-01-25T09:36:59.423 INFO:teuthology.orchestra.run.smithi138.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-01-25T09:36:59.424 INFO:teuthology.orchestra.run.smithi138.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-01-25T09:36:59.425 INFO:teuthology.orchestra.run.smithi138.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-01-25T09:36:59.426 INFO:teuthology.orchestra.run.smithi138.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-01-25T09:36:59.456 INFO:teuthology.orchestra.run.smithi138.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-01-25T09:36:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-01-25T09:36:59.457 INFO:teuthology.orchestra.run.smithi138.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-01-25T09:36:59.457 INFO:teuthology.orchestra.run.smithi035.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-01-25T09:36:59.529 INFO:teuthology.orchestra.run.smithi035.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-01-25T09:36:59.530 INFO:teuthology.orchestra.run.smithi035.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-01-25T09:36:59.530 INFO:teuthology.orchestra.run.smithi035.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-01-25T09:36:59.531 INFO:teuthology.orchestra.run.smithi035.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-01-25T09:36:59.531 INFO:teuthology.orchestra.run.smithi035.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-01-25T09:36:59.539 INFO:teuthology.orchestra.run.smithi035.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-01-25T09:36:59.539 INFO:teuthology.orchestra.run.smithi035.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-01-25T09:36:59.547 INFO:teuthology.orchestra.run.smithi138.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-01-25T09:36:59.552 INFO:teuthology.orchestra.run.smithi138.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-01-25T09:36:59.555 INFO:teuthology.orchestra.run.smithi138.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-01-25T09:36:59.559 INFO:teuthology.orchestra.run.smithi138.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-01-25T09:36:59.560 INFO:teuthology.orchestra.run.smithi138.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-01-25T09:36:59.563 INFO:teuthology.orchestra.run.smithi138.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-01-25T09:36:59.566 INFO:teuthology.orchestra.run.smithi138.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-01-25T09:36:59.607 INFO:teuthology.orchestra.run.smithi035.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-01-25T09:36:59.608 INFO:teuthology.orchestra.run.smithi035.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-01-25T09:36:59.643 INFO:teuthology.orchestra.run.smithi138.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-01-25T09:36:59.649 INFO:teuthology.orchestra.run.smithi138.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-01-25T09:36:59.653 INFO:teuthology.orchestra.run.smithi138.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-01-25T09:36:59.699 INFO:teuthology.orchestra.run.smithi035.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-01-25T09:36:59.704 INFO:teuthology.orchestra.run.smithi035.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-01-25T09:36:59.707 INFO:teuthology.orchestra.run.smithi035.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-01-25T09:36:59.710 INFO:teuthology.orchestra.run.smithi035.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-01-25T09:36:59.712 INFO:teuthology.orchestra.run.smithi035.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-01-25T09:36:59.715 INFO:teuthology.orchestra.run.smithi035.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-01-25T09:36:59.718 INFO:teuthology.orchestra.run.smithi035.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-01-25T09:36:59.777 INFO:teuthology.orchestra.run.smithi035.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-1986-g44e4095d-1focal [104 kB] 2023-01-25T09:36:59.778 INFO:teuthology.orchestra.run.smithi035.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-1986-g44e4095d-1focal [467 kB] 2023-01-25T09:36:59.795 INFO:teuthology.orchestra.run.smithi035.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-01-25T09:36:59.799 INFO:teuthology.orchestra.run.smithi035.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-01-25T09:36:59.805 INFO:teuthology.orchestra.run.smithi035.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-01-25T09:36:59.818 INFO:teuthology.orchestra.run.smithi035.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-1986-g44e4095d-1focal [24.9 MB] 2023-01-25T09:36:59.826 INFO:teuthology.orchestra.run.smithi138.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-01-25T09:36:59.827 INFO:teuthology.orchestra.run.smithi138.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-01-25T09:36:59.828 INFO:teuthology.orchestra.run.smithi138.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-01-25T09:36:59.829 INFO:teuthology.orchestra.run.smithi138.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-01-25T09:36:59.855 INFO:teuthology.orchestra.run.smithi138.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-01-25T09:36:59.855 INFO:teuthology.orchestra.run.smithi138.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-01-25T09:36:59.856 INFO:teuthology.orchestra.run.smithi138.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-01-25T09:36:59.856 INFO:teuthology.orchestra.run.smithi138.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-01-25T09:36:59.857 INFO:teuthology.orchestra.run.smithi138.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-01-25T09:36:59.983 INFO:teuthology.orchestra.run.smithi035.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-01-25T09:36:59.985 INFO:teuthology.orchestra.run.smithi035.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-01-25T09:36:59.985 INFO:teuthology.orchestra.run.smithi035.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-01-25T09:36:59.988 INFO:teuthology.orchestra.run.smithi035.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-01-25T09:37:00.028 INFO:teuthology.orchestra.run.smithi035.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-01-25T09:37:00.029 INFO:teuthology.orchestra.run.smithi035.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-01-25T09:37:00.033 INFO:teuthology.orchestra.run.smithi035.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-01-25T09:37:00.034 INFO:teuthology.orchestra.run.smithi035.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-01-25T09:37:00.035 INFO:teuthology.orchestra.run.smithi035.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-01-25T09:37:00.487 INFO:teuthology.orchestra.run.smithi138.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-1986-g44e4095d-1focal [10.3 MB] 2023-01-25T09:37:01.282 INFO:teuthology.orchestra.run.smithi138.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-1986-g44e4095d-1focal [221 kB] 2023-01-25T09:37:01.284 INFO:teuthology.orchestra.run.smithi138.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-1986-g44e4095d-1focal [133 kB] 2023-01-25T09:37:01.286 INFO:teuthology.orchestra.run.smithi138.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-1986-g44e4095d-1focal [1,534 kB] 2023-01-25T09:37:01.389 INFO:teuthology.orchestra.run.smithi138.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-1986-g44e4095d-1focal [7,860 kB] 2023-01-25T09:37:01.398 INFO:teuthology.orchestra.run.smithi035.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-1986-g44e4095d-1focal [10.3 MB] 2023-01-25T09:37:01.908 INFO:teuthology.orchestra.run.smithi035.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-1986-g44e4095d-1focal [221 kB] 2023-01-25T09:37:01.912 INFO:teuthology.orchestra.run.smithi035.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-1986-g44e4095d-1focal [133 kB] 2023-01-25T09:37:01.928 INFO:teuthology.orchestra.run.smithi035.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-1986-g44e4095d-1focal [1,534 kB] 2023-01-25T09:37:02.003 INFO:teuthology.orchestra.run.smithi035.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-1986-g44e4095d-1focal [7,860 kB] 2023-01-25T09:37:02.026 INFO:teuthology.orchestra.run.smithi138.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-1986-g44e4095d-1focal [27.5 MB] 2023-01-25T09:37:02.544 INFO:teuthology.orchestra.run.smithi035.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-1986-g44e4095d-1focal [27.5 MB] 2023-01-25T09:37:06.166 INFO:teuthology.orchestra.run.smithi138.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-1986-g44e4095d-1focal [3,808 B] 2023-01-25T09:37:06.167 INFO:teuthology.orchestra.run.smithi138.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-1986-g44e4095d-1focal [829 kB] 2023-01-25T09:37:06.234 INFO:teuthology.orchestra.run.smithi138.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-1986-g44e4095d-1focal [2,279 kB] 2023-01-25T09:37:06.517 INFO:teuthology.orchestra.run.smithi138.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-1986-g44e4095d-1focal [96.2 kB] 2023-01-25T09:37:06.520 INFO:teuthology.orchestra.run.smithi138.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-1986-g44e4095d-1focal [115 kB] 2023-01-25T09:37:06.540 INFO:teuthology.orchestra.run.smithi138.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-1986-g44e4095d-1focal [1,787 kB] 2023-01-25T09:37:06.607 INFO:teuthology.orchestra.run.smithi035.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-1986-g44e4095d-1focal [3,808 B] 2023-01-25T09:37:06.608 INFO:teuthology.orchestra.run.smithi035.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-1986-g44e4095d-1focal [829 kB] 2023-01-25T09:37:06.673 INFO:teuthology.orchestra.run.smithi035.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-1986-g44e4095d-1focal [2,279 kB] 2023-01-25T09:37:06.742 INFO:teuthology.orchestra.run.smithi138.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-1986-g44e4095d-1focal [7,881 kB] 2023-01-25T09:37:06.896 INFO:teuthology.orchestra.run.smithi035.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-1986-g44e4095d-1focal [96.2 kB] 2023-01-25T09:37:06.914 INFO:teuthology.orchestra.run.smithi035.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-1986-g44e4095d-1focal [115 kB] 2023-01-25T09:37:06.917 INFO:teuthology.orchestra.run.smithi035.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-1986-g44e4095d-1focal [1,787 kB] 2023-01-25T09:37:07.098 INFO:teuthology.orchestra.run.smithi035.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-1986-g44e4095d-1focal [7,881 kB] 2023-01-25T09:37:07.833 INFO:teuthology.orchestra.run.smithi138.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-1986-g44e4095d-1focal [3,932 B] 2023-01-25T09:37:07.833 INFO:teuthology.orchestra.run.smithi138.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-1986-g44e4095d-1focal [48.3 MB] 2023-01-25T09:37:08.095 INFO:teuthology.orchestra.run.smithi035.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-1986-g44e4095d-1focal [3,932 B] 2023-01-25T09:37:08.097 INFO:teuthology.orchestra.run.smithi035.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-1986-g44e4095d-1focal [48.3 MB] 2023-01-25T09:37:11.854 INFO:teuthology.orchestra.run.smithi035.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-1986-g44e4095d-1focal [225 kB] 2023-01-25T09:37:11.859 INFO:teuthology.orchestra.run.smithi035.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-1986-g44e4095d-1focal [27.4 kB] 2023-01-25T09:37:11.859 INFO:teuthology.orchestra.run.smithi035.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-1986-g44e4095d-1focal [13.3 MB] 2023-01-25T09:37:11.868 INFO:teuthology.orchestra.run.smithi138.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-1986-g44e4095d-1focal [225 kB] 2023-01-25T09:37:11.873 INFO:teuthology.orchestra.run.smithi138.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-1986-g44e4095d-1focal [27.4 kB] 2023-01-25T09:37:11.874 INFO:teuthology.orchestra.run.smithi138.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-1986-g44e4095d-1focal [13.3 MB] 2023-01-25T09:37:12.684 INFO:teuthology.orchestra.run.smithi138.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-1986-g44e4095d-1focal [97.2 kB] 2023-01-25T09:37:12.696 INFO:teuthology.orchestra.run.smithi035.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-1986-g44e4095d-1focal [97.2 kB] 2023-01-25T09:37:13.301 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 199 MB in 15s (12.9 MB/s) 2023-01-25T09:37:13.335 INFO:teuthology.orchestra.run.smithi035.stdout:Fetched 199 MB in 15s (13.0 MB/s) 2023-01-25T09:37:13.469 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-01-25T09:37:13.475 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-01-25T09:37:13.526 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141754 files and directories currently installed.) 2023-01-25T09:37:13.530 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-01-25T09:37:13.532 INFO:teuthology.orchestra.run.smithi035.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141754 files and directories currently installed.) 2023-01-25T09:37:13.536 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-01-25T09:37:13.615 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-25T09:37:13.643 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-25T09:37:13.977 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-01-25T09:37:13.988 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-01-25T09:37:13.995 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-01-25T09:37:14.007 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-01-25T09:37:14.035 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-25T09:37:14.046 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-25T09:37:14.366 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-01-25T09:37:14.371 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-01-25T09:37:14.384 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-01-25T09:37:14.388 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-01-25T09:37:14.416 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-25T09:37:14.430 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-25T09:37:14.833 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-01-25T09:37:14.850 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T09:37:14.877 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-01-25T09:37:14.893 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T09:37:14.901 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:37:14.946 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:37:15.411 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-01-25T09:37:15.431 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T09:37:15.461 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:37:15.698 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-01-25T09:37:15.713 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T09:37:15.755 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:37:15.814 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-01-25T09:37:15.830 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T09:37:15.872 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:37:16.084 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-01-25T09:37:16.099 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-25T09:37:16.133 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:37:16.258 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-01-25T09:37:16.274 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-01-25T09:37:16.317 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-25T09:37:16.537 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-01-25T09:37:16.553 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-01-25T09:37:16.595 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-25T09:37:16.712 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../007-librbd1_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:16.812 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking librbd1 (18.0.0-1986-g44e4095d-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-25T09:37:16.979 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../007-librbd1_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:17.107 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librbd1 (18.0.0-1986-g44e4095d-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-25T09:37:17.482 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../008-librados2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:17.607 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking librados2 (18.0.0-1986-g44e4095d-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-25T09:37:17.794 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../008-librados2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:17.903 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librados2 (18.0.0-1986-g44e4095d-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-25T09:37:18.336 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libcephfs2. 2023-01-25T09:37:18.353 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../009-libcephfs2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:18.394 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libcephfs2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:18.665 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs2. 2023-01-25T09:37:18.672 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-rados. 2023-01-25T09:37:18.681 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../009-libcephfs2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:18.688 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../010-python3-rados_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:18.722 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-rados (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:18.723 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:19.058 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-01-25T09:37:19.067 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rados. 2023-01-25T09:37:19.074 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:37:19.084 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../010-python3-rados_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:19.117 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rados (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:19.124 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-ceph-argparse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:19.376 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-cephfs. 2023-01-25T09:37:19.393 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../012-python3-cephfs_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:19.434 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-cephfs (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:19.470 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-01-25T09:37:19.487 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:37:19.528 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-argparse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:19.738 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-ceph-common. 2023-01-25T09:37:19.754 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../013-python3-ceph-common_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:37:19.780 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cephfs. 2023-01-25T09:37:19.796 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:19.797 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../012-python3-cephfs_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:19.839 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cephfs (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:20.124 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-prettytable. 2023-01-25T09:37:20.143 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-01-25T09:37:20.175 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-common. 2023-01-25T09:37:20.182 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-01-25T09:37:20.192 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../013-python3-ceph-common_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:37:20.233 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:20.435 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-rbd. 2023-01-25T09:37:20.451 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../015-python3-rbd_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:20.493 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-rbd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:20.569 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-prettytable. 2023-01-25T09:37:20.587 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-01-25T09:37:20.619 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-01-25T09:37:20.847 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rbd. 2023-01-25T09:37:20.866 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../015-python3-rbd_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:20.879 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-01-25T09:37:20.896 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rbd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:20.897 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-01-25T09:37:20.937 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-25T09:37:21.258 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-01-25T09:37:21.274 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-01-25T09:37:21.304 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-01-25T09:37:21.321 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-01-25T09:37:21.341 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-25T09:37:21.362 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-01-25T09:37:21.680 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-01-25T09:37:21.683 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-01-25T09:37:21.699 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-01-25T09:37:21.700 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-01-25T09:37:21.740 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-25T09:37:21.741 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-01-25T09:37:22.084 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package librgw2. 2023-01-25T09:37:22.101 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../019-librgw2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:22.102 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-01-25T09:37:22.120 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-01-25T09:37:22.143 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking librgw2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:22.161 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-25T09:37:22.497 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librgw2. 2023-01-25T09:37:22.514 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../019-librgw2_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:22.547 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librgw2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:23.028 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-rgw. 2023-01-25T09:37:23.047 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:23.087 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-rgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:23.458 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rgw. 2023-01-25T09:37:23.464 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package liboath0. 2023-01-25T09:37:23.476 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:23.481 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-01-25T09:37:23.516 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:23.522 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-01-25T09:37:23.819 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liboath0. 2023-01-25T09:37:23.826 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libradosstriper1. 2023-01-25T09:37:23.839 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-01-25T09:37:23.842 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:23.868 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-01-25T09:37:23.884 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libradosstriper1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:24.181 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libradosstriper1. 2023-01-25T09:37:24.198 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:24.266 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libradosstriper1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:24.371 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-common. 2023-01-25T09:37:24.388 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../023-ceph-common_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:24.433 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:24.659 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-common. 2023-01-25T09:37:24.678 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../023-ceph-common_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:24.733 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:26.909 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-base. 2023-01-25T09:37:26.927 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../024-ceph-base_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:26.970 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-base (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:27.289 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-base. 2023-01-25T09:37:27.305 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../024-ceph-base_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:27.358 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-base (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:28.339 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-cherrypy3. 2023-01-25T09:37:28.355 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-01-25T09:37:28.397 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-01-25T09:37:28.702 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cherrypy3. 2023-01-25T09:37:28.720 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-01-25T09:37:28.752 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-01-25T09:37:28.783 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-natsort. 2023-01-25T09:37:28.800 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-01-25T09:37:28.841 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-01-25T09:37:29.122 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-natsort. 2023-01-25T09:37:29.140 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-01-25T09:37:29.153 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-logutils. 2023-01-25T09:37:29.169 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-01-25T09:37:29.180 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-01-25T09:37:29.211 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-01-25T09:37:29.504 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-logutils. 2023-01-25T09:37:29.514 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-markupsafe. 2023-01-25T09:37:29.523 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-01-25T09:37:29.532 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-01-25T09:37:29.564 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-01-25T09:37:29.566 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-01-25T09:37:29.867 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-mako. 2023-01-25T09:37:29.869 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-markupsafe. 2023-01-25T09:37:29.884 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-01-25T09:37:29.885 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-01-25T09:37:29.925 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-25T09:37:29.927 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-01-25T09:37:30.261 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-simplegeneric. 2023-01-25T09:37:30.263 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-mako. 2023-01-25T09:37:30.277 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-01-25T09:37:30.280 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-01-25T09:37:30.322 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-25T09:37:30.545 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-01-25T09:37:30.675 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplegeneric. 2023-01-25T09:37:30.692 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-01-25T09:37:31.317 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-01-25T09:37:31.522 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-singledispatch. 2023-01-25T09:37:31.539 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-01-25T09:37:31.572 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-01-25T09:37:31.711 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-singledispatch. 2023-01-25T09:37:31.731 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-01-25T09:37:31.769 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-01-25T09:37:31.800 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-webob. 2023-01-25T09:37:31.816 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-01-25T09:37:31.850 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-01-25T09:37:32.055 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webob. 2023-01-25T09:37:32.075 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-01-25T09:37:32.094 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-soupsieve. 2023-01-25T09:37:32.105 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-01-25T09:37:32.112 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-01-25T09:37:32.176 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-25T09:37:32.392 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-soupsieve. 2023-01-25T09:37:32.408 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-01-25T09:37:32.450 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-25T09:37:32.488 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-bs4. 2023-01-25T09:37:32.507 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-01-25T09:37:32.547 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-01-25T09:37:32.786 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-bs4. 2023-01-25T09:37:32.804 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-01-25T09:37:32.844 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-01-25T09:37:32.899 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-waitress. 2023-01-25T09:37:32.917 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-01-25T09:37:32.961 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-25T09:37:33.222 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-waitress. 2023-01-25T09:37:33.238 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-01-25T09:37:33.286 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-25T09:37:33.306 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-tempita. 2023-01-25T09:37:33.353 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-01-25T09:37:33.363 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-01-25T09:37:33.636 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempita. 2023-01-25T09:37:33.653 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-01-25T09:37:33.666 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-paste. 2023-01-25T09:37:33.682 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-01-25T09:37:33.695 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-01-25T09:37:33.716 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-01-25T09:37:34.031 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-paste. 2023-01-25T09:37:34.048 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-01-25T09:37:34.052 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-01-25T09:37:34.071 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-01-25T09:37:34.089 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-01-25T09:37:34.110 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-01-25T09:37:34.401 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-01-25T09:37:34.418 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-01-25T09:37:34.421 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-pastedeploy. 2023-01-25T09:37:34.438 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-01-25T09:37:34.472 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-01-25T09:37:34.475 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-01-25T09:37:34.787 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastedeploy. 2023-01-25T09:37:34.800 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-webtest. 2023-01-25T09:37:34.802 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-01-25T09:37:34.817 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-01-25T09:37:34.845 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-01-25T09:37:34.858 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-01-25T09:37:35.152 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-pecan. 2023-01-25T09:37:35.171 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-01-25T09:37:35.181 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webtest. 2023-01-25T09:37:35.200 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-01-25T09:37:35.202 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-01-25T09:37:35.248 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-01-25T09:37:35.515 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-werkzeug. 2023-01-25T09:37:35.535 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2023-01-25T09:37:35.573 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-25T09:37:35.593 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pecan. 2023-01-25T09:37:35.609 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-01-25T09:37:35.651 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-01-25T09:37:35.885 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-01-25T09:37:35.902 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:37:35.943 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-mgr-modules-core (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:36.031 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-werkzeug. 2023-01-25T09:37:36.046 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2023-01-25T09:37:36.089 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-25T09:37:36.314 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-01-25T09:37:36.331 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:36.372 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:36.417 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-01-25T09:37:36.433 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:37:36.475 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-modules-core (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:36.734 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-cryptography. 2023-01-25T09:37:36.750 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-01-25T09:37:36.791 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-25T09:37:36.880 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-01-25T09:37:36.896 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:36.938 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:37.162 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-openssl. 2023-01-25T09:37:37.178 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-01-25T09:37:37.219 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-01-25T09:37:37.268 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cryptography. 2023-01-25T09:37:37.285 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-01-25T09:37:37.360 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-25T09:37:37.589 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-mgr. 2023-01-25T09:37:37.606 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../047-ceph-mgr_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:37.647 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-mgr (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:37.732 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-openssl. 2023-01-25T09:37:37.751 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-01-25T09:37:37.790 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-01-25T09:37:38.126 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-mon. 2023-01-25T09:37:38.142 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../048-ceph-mon_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:38.169 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr. 2023-01-25T09:37:38.184 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-mon (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:38.185 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../047-ceph-mgr_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:38.227 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:38.714 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mon. 2023-01-25T09:37:38.731 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../048-ceph-mon_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:38.806 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mon (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:39.346 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-osd. 2023-01-25T09:37:39.362 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../049-ceph-osd_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:39.412 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-osd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:39.977 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-osd. 2023-01-25T09:37:39.993 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../049-ceph-osd_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:40.035 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-osd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:42.115 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph. 2023-01-25T09:37:42.135 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../050-ceph_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:42.173 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:42.492 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-fuse. 2023-01-25T09:37:42.509 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../051-ceph-fuse_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:42.576 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:42.806 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph. 2023-01-25T09:37:42.824 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../050-ceph_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:42.864 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:42.995 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-mds. 2023-01-25T09:37:43.012 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../052-ceph-mds_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:43.062 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-mds (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:43.183 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-fuse. 2023-01-25T09:37:43.200 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../051-ceph-fuse_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:43.258 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:43.631 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package cephadm. 2023-01-25T09:37:43.649 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../053-cephadm_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:43.679 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mds. 2023-01-25T09:37:43.690 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:43.699 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../052-ceph-mds_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:43.745 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mds (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:43.967 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-asyncssh. 2023-01-25T09:37:43.987 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-01-25T09:37:44.025 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-01-25T09:37:44.290 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephadm. 2023-01-25T09:37:44.306 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../053-cephadm_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:37:44.348 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:44.386 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-jinja2. 2023-01-25T09:37:44.404 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-01-25T09:37:44.436 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-01-25T09:37:44.694 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-asyncssh. 2023-01-25T09:37:44.712 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-01-25T09:37:44.752 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-01-25T09:37:44.758 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-01-25T09:37:44.776 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:37:44.816 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-mgr-cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:45.122 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jinja2. 2023-01-25T09:37:45.140 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-01-25T09:37:45.186 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-bcrypt. 2023-01-25T09:37:45.197 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-01-25T09:37:45.202 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-01-25T09:37:45.244 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-25T09:37:45.517 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-01-25T09:37:45.533 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:37:45.547 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-jwt. 2023-01-25T09:37:45.565 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-01-25T09:37:45.575 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:45.605 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-25T09:37:45.917 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-attr. 2023-01-25T09:37:45.934 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2023-01-25T09:37:45.954 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-bcrypt. 2023-01-25T09:37:45.970 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-01-25T09:37:45.996 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-01-25T09:37:46.003 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-25T09:37:46.337 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-pluggy. 2023-01-25T09:37:46.356 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2023-01-25T09:37:46.374 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jwt. 2023-01-25T09:37:46.392 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-01-25T09:37:46.394 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-01-25T09:37:46.432 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-25T09:37:46.798 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-py. 2023-01-25T09:37:46.818 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-01-25T09:37:46.889 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-01-25T09:37:47.136 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-attr. 2023-01-25T09:37:47.155 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2023-01-25T09:37:47.194 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-01-25T09:37:47.218 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-atomicwrites. 2023-01-25T09:37:47.236 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-01-25T09:37:47.276 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-01-25T09:37:47.564 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pluggy. 2023-01-25T09:37:47.579 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-packaging. 2023-01-25T09:37:47.583 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2023-01-25T09:37:47.595 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2023-01-25T09:37:47.622 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-01-25T09:37:47.637 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-packaging (20.3-1) ... 2023-01-25T09:37:47.942 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-py. 2023-01-25T09:37:47.960 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-01-25T09:37:47.973 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-wcwidth. 2023-01-25T09:37:47.990 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-01-25T09:37:48.000 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-01-25T09:37:48.031 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-25T09:37:48.334 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-pytest. 2023-01-25T09:37:48.337 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-atomicwrites. 2023-01-25T09:37:48.351 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2023-01-25T09:37:48.353 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-01-25T09:37:48.392 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-01-25T09:37:48.395 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-01-25T09:37:48.716 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-packaging. 2023-01-25T09:37:48.733 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2023-01-25T09:37:48.755 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-repoze.lru. 2023-01-25T09:37:48.771 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2023-01-25T09:37:48.773 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-packaging (20.3-1) ... 2023-01-25T09:37:48.813 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-01-25T09:37:49.082 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libjs-underscore. 2023-01-25T09:37:49.099 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-01-25T09:37:49.110 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-wcwidth. 2023-01-25T09:37:49.126 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-01-25T09:37:49.140 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-25T09:37:49.169 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-25T09:37:49.427 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-01-25T09:37:49.445 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-01-25T09:37:49.493 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-25T09:37:49.505 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pytest. 2023-01-25T09:37:49.521 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2023-01-25T09:37:49.555 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-01-25T09:37:49.821 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-routes. 2023-01-25T09:37:49.839 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2023-01-25T09:37:49.879 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-01-25T09:37:49.917 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-repoze.lru. 2023-01-25T09:37:49.935 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2023-01-25T09:37:49.984 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-01-25T09:37:50.199 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-01-25T09:37:50.217 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:37:50.245 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjs-underscore. 2023-01-25T09:37:50.257 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-mgr-dashboard (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:50.263 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-01-25T09:37:50.303 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-25T09:37:50.582 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-01-25T09:37:50.597 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-01-25T09:37:50.639 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-25T09:37:50.711 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-decorator. 2023-01-25T09:37:50.727 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-01-25T09:37:50.769 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-01-25T09:37:50.984 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-routes. 2023-01-25T09:37:51.003 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2023-01-25T09:37:51.042 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-01-25T09:37:51.055 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-01-25T09:37:51.075 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-01-25T09:37:51.113 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-25T09:37:51.404 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-01-25T09:37:51.423 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:37:51.458 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-scipy. 2023-01-25T09:37:51.462 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-dashboard (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:51.478 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-01-25T09:37:51.516 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-01-25T09:37:51.967 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-decorator. 2023-01-25T09:37:51.987 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-01-25T09:37:52.025 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-01-25T09:37:52.286 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-01-25T09:37:52.306 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-01-25T09:37:52.361 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-25T09:37:52.657 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-scipy. 2023-01-25T09:37:52.673 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-01-25T09:37:52.711 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-01-25T09:37:52.765 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-01-25T09:37:52.783 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-01-25T09:37:52.814 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-25T09:37:53.394 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-joblib. 2023-01-25T09:37:53.410 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2023-01-25T09:37:53.452 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-01-25T09:37:53.882 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-sklearn. 2023-01-25T09:37:53.898 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-01-25T09:37:53.940 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-25T09:37:54.007 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-01-25T09:37:54.025 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-01-25T09:37:54.065 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-25T09:37:54.593 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-01-25T09:37:54.609 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:37:54.621 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-joblib. 2023-01-25T09:37:54.640 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2023-01-25T09:37:54.679 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-01-25T09:37:54.684 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:55.075 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn. 2023-01-25T09:37:55.093 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-01-25T09:37:55.133 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-25T09:37:55.821 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-cachetools. 2023-01-25T09:37:55.838 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2023-01-25T09:37:55.872 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-01-25T09:37:55.880 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-01-25T09:37:55.889 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:37:55.930 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:37:56.174 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-pyasn1. 2023-01-25T09:37:56.195 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-01-25T09:37:56.233 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-01-25T09:37:56.594 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-01-25T09:37:56.615 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-01-25T09:37:56.702 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-25T09:37:57.075 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cachetools. 2023-01-25T09:37:57.083 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-rsa. 2023-01-25T09:37:57.095 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2023-01-25T09:37:57.103 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2023-01-25T09:37:57.133 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-rsa (4.0-3) ... 2023-01-25T09:37:57.133 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-01-25T09:37:57.478 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1. 2023-01-25T09:37:57.479 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-google-auth. 2023-01-25T09:37:57.494 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-01-25T09:37:57.495 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2023-01-25T09:37:57.528 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-01-25T09:37:57.536 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-01-25T09:37:57.816 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-blinker. 2023-01-25T09:37:57.835 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-01-25T09:37:57.874 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-25T09:37:57.882 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-01-25T09:37:57.898 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-01-25T09:37:57.940 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-25T09:37:58.202 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-oauthlib. 2023-01-25T09:37:58.220 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-01-25T09:37:58.260 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-25T09:37:58.363 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rsa. 2023-01-25T09:37:58.383 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2023-01-25T09:37:58.421 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rsa (4.0-3) ... 2023-01-25T09:37:58.572 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-01-25T09:37:58.589 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-01-25T09:37:58.630 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-25T09:37:58.759 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-google-auth. 2023-01-25T09:37:58.776 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2023-01-25T09:37:58.817 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-01-25T09:37:58.950 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-websocket. 2023-01-25T09:37:58.971 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-01-25T09:37:59.033 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-01-25T09:37:59.139 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-blinker. 2023-01-25T09:37:59.159 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-01-25T09:37:59.213 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-25T09:37:59.345 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-kubernetes. 2023-01-25T09:37:59.364 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-01-25T09:37:59.412 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-01-25T09:37:59.534 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-oauthlib. 2023-01-25T09:37:59.550 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-01-25T09:37:59.592 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-25T09:37:59.947 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-01-25T09:37:59.963 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-01-25T09:37:59.993 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-01-25T09:38:00.004 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-25T09:38:00.012 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:38:00.051 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:00.325 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-websocket. 2023-01-25T09:38:00.342 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-01-25T09:38:00.364 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libonig5:amd64. 2023-01-25T09:38:00.381 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2023-01-25T09:38:00.383 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-01-25T09:38:00.422 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-01-25T09:38:00.703 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-kubernetes. 2023-01-25T09:38:00.724 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-01-25T09:38:00.761 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-01-25T09:38:00.798 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libjq1:amd64. 2023-01-25T09:38:00.817 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-25T09:38:00.856 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:38:01.109 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package jq. 2023-01-25T09:38:01.128 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-25T09:38:01.167 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:38:01.380 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-01-25T09:38:01.397 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:38:01.420 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package socat. 2023-01-25T09:38:01.429 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:01.438 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2023-01-25T09:38:01.478 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking socat (1.7.3.3-2) ... 2023-01-25T09:38:01.751 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libonig5:amd64. 2023-01-25T09:38:01.771 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2023-01-25T09:38:01.799 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package xmlstarlet. 2023-01-25T09:38:01.809 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-01-25T09:38:01.816 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-01-25T09:38:01.857 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-01-25T09:38:02.176 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjq1:amd64. 2023-01-25T09:38:02.193 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-25T09:38:02.235 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:38:02.454 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-test. 2023-01-25T09:38:02.472 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../094-ceph-test_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:38:02.512 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-test (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:02.538 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package jq. 2023-01-25T09:38:02.559 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-25T09:38:02.596 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:38:02.833 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package socat. 2023-01-25T09:38:02.852 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2023-01-25T09:38:02.883 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking socat (1.7.3.3-2) ... 2023-01-25T09:38:03.212 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package xmlstarlet. 2023-01-25T09:38:03.229 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-01-25T09:38:03.270 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-01-25T09:38:03.600 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-test. 2023-01-25T09:38:03.617 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../094-ceph-test_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:38:03.658 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-test (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:06.758 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package ceph-volume. 2023-01-25T09:38:06.776 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../095-ceph-volume_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:38:06.850 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking ceph-volume (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:07.146 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package fonts-mathjax. 2023-01-25T09:38:07.164 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-25T09:38:07.204 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:38:07.766 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libcephfs-dev. 2023-01-25T09:38:07.783 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:38:07.824 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libcephfs-dev (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:08.068 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-volume. 2023-01-25T09:38:08.083 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../095-ceph-volume_18.0.0-1986-g44e4095d-1focal_all.deb ... 2023-01-25T09:38:08.122 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-volume (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:08.228 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package nvme-cli. 2023-01-25T09:38:08.245 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-01-25T09:38:08.303 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-01-25T09:38:08.444 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package fonts-mathjax. 2023-01-25T09:38:08.461 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-25T09:38:08.502 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:38:08.641 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-01-25T09:38:08.660 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-01-25T09:38:08.699 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-01-25T09:38:09.073 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs-dev. 2023-01-25T09:38:09.077 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package libjs-mathjax. 2023-01-25T09:38:09.092 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:38:09.094 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-25T09:38:09.131 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs-dev (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:09.136 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:38:09.552 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package nvme-cli. 2023-01-25T09:38:09.569 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-01-25T09:38:09.627 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-01-25T09:38:09.949 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-01-25T09:38:09.968 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-01-25T09:38:10.015 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-01-25T09:38:10.412 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjs-mathjax. 2023-01-25T09:38:10.431 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-25T09:38:10.495 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:38:10.794 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python-natsort-doc. 2023-01-25T09:38:10.814 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-01-25T09:38:10.852 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-01-25T09:38:11.207 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-webencodings. 2023-01-25T09:38:11.224 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-01-25T09:38:11.265 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-25T09:38:11.526 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-html5lib. 2023-01-25T09:38:11.545 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-01-25T09:38:11.584 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-01-25T09:38:11.937 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-01-25T09:38:11.954 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-01-25T09:38:11.995 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-25T09:38:12.172 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-natsort-doc. 2023-01-25T09:38:12.190 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-01-25T09:38:12.230 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-01-25T09:38:12.432 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-pastescript. 2023-01-25T09:38:12.449 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2023-01-25T09:38:12.490 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-01-25T09:38:12.575 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webencodings. 2023-01-25T09:38:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-01-25T09:38:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-25T09:38:12.810 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-psutil. 2023-01-25T09:38:12.827 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-01-25T09:38:12.868 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-01-25T09:38:12.962 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-html5lib. 2023-01-25T09:38:12.978 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-01-25T09:38:13.020 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-01-25T09:38:13.204 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-pyinotify. 2023-01-25T09:38:13.222 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-01-25T09:38:13.262 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-25T09:38:13.365 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-01-25T09:38:13.382 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-01-25T09:38:13.448 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-25T09:38:13.582 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package python3-simplejson. 2023-01-25T09:38:13.599 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-01-25T09:38:13.640 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-25T09:38:13.927 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastescript. 2023-01-25T09:38:13.942 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-01-25T09:38:13.944 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2023-01-25T09:38:13.961 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-01-25T09:38:13.985 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-01-25T09:38:14.000 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-25T09:38:14.306 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-psutil. 2023-01-25T09:38:14.327 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-01-25T09:38:14.364 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-01-25T09:38:14.704 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package radosgw. 2023-01-25T09:38:14.709 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyinotify. 2023-01-25T09:38:14.722 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../110-radosgw_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:38:14.726 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-01-25T09:38:14.768 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-25T09:38:14.770 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking radosgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:15.087 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplejson. 2023-01-25T09:38:15.108 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-01-25T09:38:15.145 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-25T09:38:15.449 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-01-25T09:38:15.466 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-01-25T09:38:15.507 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-25T09:38:16.141 INFO:teuthology.orchestra.run.smithi035.stdout:Selecting previously unselected package rbd-fuse. 2023-01-25T09:38:16.158 INFO:teuthology.orchestra.run.smithi035.stdout:Preparing to unpack .../111-rbd-fuse_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:38:16.195 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package radosgw. 2023-01-25T09:38:16.198 INFO:teuthology.orchestra.run.smithi035.stdout:Unpacking rbd-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:16.211 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../110-radosgw_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:38:16.253 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking radosgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:16.531 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-attr (19.3.0-2) ... 2023-01-25T09:38:16.828 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-01-25T09:38:16.955 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-25T09:38:17.081 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-01-25T09:38:17.299 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:18.019 INFO:teuthology.orchestra.run.smithi035.stdout:Adding system user cephadm....done 2023-01-25T09:38:18.174 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package rbd-fuse. 2023-01-25T09:38:18.190 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../111-rbd-fuse_18.0.0-1986-g44e4095d-1focal_amd64.deb ... 2023-01-25T09:38:18.214 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:38:18.232 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking rbd-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:18.339 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-25T09:38:18.563 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-attr (19.3.0-2) ... 2023-01-25T09:38:18.683 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-01-25T09:38:18.897 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-01-25T09:38:18.984 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:38:19.022 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-25T09:38:19.110 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-01-25T09:38:19.148 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-01-25T09:38:19.236 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-01-25T09:38:19.367 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:19.579 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-01-25T09:38:19.998 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-25T09:38:20.029 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user cephadm....done 2023-01-25T09:38:20.192 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:38:20.291 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-01-25T09:38:20.343 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-25T09:38:20.592 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-25T09:38:20.695 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-01-25T09:38:20.918 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-25T09:38:21.021 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-25T09:38:21.164 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-01-25T09:38:21.219 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-ceph-argparse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:21.315 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-01-25T09:38:21.528 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-25T09:38:21.645 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-01-25T09:38:21.687 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-01-25T09:38:21.972 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-25T09:38:22.036 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-25T09:38:22.273 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-25T09:38:22.329 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-01-25T09:38:22.399 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-01-25T09:38:22.622 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-25T09:38:22.809 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-01-25T09:38:22.940 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-25T09:38:23.118 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-01-25T09:38:23.250 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-argparse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:23.419 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-25T09:38:23.526 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-25T09:38:23.652 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-01-25T09:38:23.787 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-01-25T09:38:23.945 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-25T09:38:24.071 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-01-25T09:38:24.222 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-25T09:38:24.348 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-01-25T09:38:24.414 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-01-25T09:38:24.725 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-01-25T09:38:24.731 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-packaging (20.3-1) ... 2023-01-25T09:38:25.017 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-01-25T09:38:25.040 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-01-25T09:38:25.167 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-25T09:38:25.293 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-25T09:38:25.327 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-25T09:38:25.586 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-01-25T09:38:25.704 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-01-25T09:38:25.987 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-25T09:38:25.988 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-01-25T09:38:26.339 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-25T09:38:26.348 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-01-25T09:38:26.649 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-packaging (20.3-1) ... 2023-01-25T09:38:26.699 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up socat (1.7.3.3-2) ... 2023-01-25T09:38:26.850 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:26.951 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-01-25T09:38:27.110 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-25T09:38:27.184 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:38:27.236 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-25T09:38:27.327 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-01-25T09:38:27.546 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-01-25T09:38:27.679 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-25T09:38:27.796 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-01-25T09:38:27.922 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-01-25T09:38:27.964 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-25T09:38:28.215 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-25T09:38:28.341 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-25T09:38:28.524 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:38:28.650 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-25T09:38:28.693 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up socat (1.7.3.3-2) ... 2023-01-25T09:38:28.776 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-01-25T09:38:28.819 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:29.103 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-01-25T09:38:29.146 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:38:29.281 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-01-25T09:38:29.396 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-01-25T09:38:29.632 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-25T09:38:29.697 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-25T09:38:29.758 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-01-25T09:38:29.822 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-01-25T09:38:29.885 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-01-25T09:38:30.115 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-01-25T09:38:30.194 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-25T09:38:30.416 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-25T09:38:30.529 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:38:30.655 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-25T09:38:30.726 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-01-25T09:38:30.781 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-01-25T09:38:31.100 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-01-25T09:38:31.121 INFO:teuthology.orchestra.run.smithi035.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-01-25T09:38:31.403 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-01-25T09:38:31.418 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-01-25T09:38:31.529 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-25T09:38:31.703 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-25T09:38:31.829 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-01-25T09:38:31.864 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-01-25T09:38:32.138 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-01-25T09:38:32.248 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-25T09:38:32.374 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-25T09:38:32.415 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-25T09:38:32.509 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-01-25T09:38:32.708 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-01-25T09:38:33.064 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-01-25T09:38:33.210 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-25T09:38:33.346 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-01-25T09:38:33.495 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-25T09:38:33.511 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-01-25T09:38:33.822 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-01-25T09:38:34.182 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-25T09:38:34.350 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-25T09:38:34.476 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-01-25T09:38:34.811 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-25T09:38:35.050 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:38:35.104 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-01-25T09:38:35.175 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-01-25T09:38:35.552 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-01-25T09:38:35.853 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-01-25T09:38:36.154 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:38:36.314 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-01-25T09:38:36.610 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:38:36.673 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-25T09:38:36.762 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-01-25T09:38:37.017 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-01-25T09:38:37.154 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-01-25T09:38:37.418 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-25T09:38:37.464 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-01-25T09:38:37.760 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-25T09:38:37.766 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-25T09:38:37.892 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-01-25T09:38:38.219 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-25T09:38:38.529 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-01-25T09:38:38.874 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-25T09:38:38.923 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-25T09:38:39.000 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-01-25T09:38:39.126 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:38:39.241 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-25T09:38:39.252 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-rsa (4.0-3) ... 2023-01-25T09:38:39.562 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-25T09:38:39.688 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-01-25T09:38:40.028 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-25T09:38:40.289 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-25T09:38:40.329 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-01-25T09:38:40.415 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-01-25T09:38:40.575 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-01-25T09:38:40.680 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-01-25T09:38:40.688 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rsa (4.0-3) ... 2023-01-25T09:38:41.015 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-25T09:38:41.041 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up librados2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:41.142 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-01-25T09:38:41.166 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-01-25T09:38:41.301 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up librgw2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:41.410 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libsqlite3-mod-ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:41.418 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-25T09:38:41.630 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libcephfs2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:41.711 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-01-25T09:38:41.773 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-routes (2.4.1-2) ... 2023-01-25T09:38:42.021 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-01-25T09:38:42.066 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libradosstriper1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:42.192 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-01-25T09:38:42.382 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librados2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:42.493 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up librbd1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:42.533 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-01-25T09:38:42.611 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-mgr-modules-core (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:42.645 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librgw2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:42.737 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:42.771 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsqlite3-mod-ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:42.965 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-25T09:38:42.966 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-25T09:38:43.007 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs2 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:43.133 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-routes (2.4.1-2) ... 2023-01-25T09:38:43.423 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up libcephfs-dev (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:43.435 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libradosstriper1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:43.544 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-01-25T09:38:43.549 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-rados (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:43.674 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-01-25T09:38:43.829 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librbd1 (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:43.989 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-modules-core (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:44.115 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:44.342 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-25T09:38:44.342 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-25T09:38:44.615 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-rbd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:44.741 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up rbd-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:44.778 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs-dev (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:44.867 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-rgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:44.921 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rados (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:45.024 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up python3-cephfs (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:45.047 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-01-25T09:38:45.143 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:45.687 INFO:teuthology.orchestra.run.smithi035.stdout:Adding group ceph....done 2023-01-25T09:38:45.959 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rbd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:46.084 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up rbd-fuse (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:46.089 INFO:teuthology.orchestra.run.smithi035.stdout:Adding system user ceph....done 2023-01-25T09:38:46.210 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:46.273 INFO:teuthology.orchestra.run.smithi035.stdout:Setting system user ceph properties....done 2023-01-25T09:38:46.294 INFO:teuthology.orchestra.run.smithi035.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-01-25T09:38:46.353 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cephfs (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:46.451 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-01-25T09:38:46.454 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-common (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:46.779 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-01-25T09:38:47.006 INFO:teuthology.orchestra.run.smithi138.stdout:Adding group ceph....done 2023-01-25T09:38:47.245 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-test (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:47.354 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up radosgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:47.409 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user ceph....done 2023-01-25T09:38:47.585 INFO:teuthology.orchestra.run.smithi138.stdout:Setting system user ceph properties....done 2023-01-25T09:38:47.607 INFO:teuthology.orchestra.run.smithi138.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-01-25T09:38:47.630 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-25T09:38:47.630 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-25T09:38:47.756 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-01-25T09:38:48.058 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-01-25T09:38:48.315 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-base (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:48.489 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-test (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:48.616 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up radosgw (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:48.943 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-25T09:38:48.943 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-25T09:38:48.994 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-01-25T09:38:49.450 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-mds (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:49.559 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-base (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:49.694 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-25T09:38:49.695 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-25T09:38:49.965 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-01-25T09:38:50.169 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-mgr (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:50.395 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mds (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:50.417 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-25T09:38:50.417 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-25T09:38:50.620 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-25T09:38:50.621 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-25T09:38:50.937 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-osd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:51.038 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:51.308 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-25T09:38:51.309 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-25T09:38:51.466 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-25T09:38:51.467 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-25T09:38:51.731 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-osd (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:51.914 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-mgr-k8sevents (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:52.015 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:52.150 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-mon (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:52.211 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-25T09:38:52.211 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-25T09:38:52.377 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-25T09:38:52.378 INFO:teuthology.orchestra.run.smithi035.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-25T09:38:52.624 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-k8sevents (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:52.750 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:52.826 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-mgr-cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:52.893 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mon (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:52.969 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:53.086 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-mgr-dashboard (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:53.146 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-25T09:38:53.146 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-25T09:38:53.221 INFO:teuthology.orchestra.run.smithi035.stdout:Setting up ceph-volume (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:53.348 INFO:teuthology.orchestra.run.smithi035.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-01-25T09:38:53.499 INFO:teuthology.orchestra.run.smithi035.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-01-25T09:38:53.561 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-cephadm (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:53.704 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:53.804 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-dashboard (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:53.892 INFO:teuthology.orchestra.run.smithi035.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-01-25T09:38:54.021 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-volume (18.0.0-1986-g44e4095d-1focal) ... 2023-01-25T09:38:54.439 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-01-25T09:38:54.643 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-01-25T09:38:54.961 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-01-25T09:38:56.920 INFO:teuthology.orchestra.run.smithi035.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-01-25T09:38:57.514 INFO:teuthology.orchestra.run.smithi035.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-01-25T09:38:57.517 DEBUG:teuthology.parallel:result is None 2023-01-25T09:38:57.781 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-01-25T09:38:58.373 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-01-25T09:38:58.376 DEBUG:teuthology.parallel:result is None 2023-01-25T09:38:58.377 DEBUG:teuthology.orchestra.run.smithi035:> sudo lsb_release -is 2023-01-25T09:38:58.430 INFO:teuthology.orchestra.run.smithi035.stdout:Ubuntu 2023-01-25T09:38:58.435 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T09:38:58.436 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:38:58.589 DEBUG:teuthology.orchestra.run.smithi035:> dpkg-query -W -f '${Version}' ceph 2023-01-25T09:38:58.614 INFO:teuthology.orchestra.run.smithi035.stdout:18.0.0-1986-g44e4095d-1focal 2023-01-25T09:38:58.615 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1986-g44e4095d-1focal 2023-01-25T09:38:58.615 INFO:teuthology.task.install:The correct ceph version 18.0.0-1986-g44e4095d-1focal is installed. 2023-01-25T09:38:58.616 DEBUG:teuthology.orchestra.run.smithi138:> sudo lsb_release -is 2023-01-25T09:38:58.666 INFO:teuthology.orchestra.run.smithi138.stdout:Ubuntu 2023-01-25T09:38:58.671 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-25T09:38:58.672 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:38:58.820 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-query -W -f '${Version}' ceph 2023-01-25T09:38:58.846 INFO:teuthology.orchestra.run.smithi138.stdout:18.0.0-1986-g44e4095d-1focal 2023-01-25T09:38:58.846 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1986-g44e4095d-1focal 2023-01-25T09:38:58.847 INFO:teuthology.task.install:The correct ceph version 18.0.0-1986-g44e4095d-1focal is installed. 2023-01-25T09:38:58.847 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-25T09:38:58.847 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:38:58.848 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T09:38:58.865 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:38:58.865 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T09:38:58.905 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-25T09:38:58.905 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:38:58.906 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T09:38:58.922 DEBUG:teuthology.orchestra.run.smithi035:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T09:38:58.980 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:38:58.981 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T09:38:58.997 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T09:38:59.007 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-25T09:38:59.008 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:38:59.008 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T09:38:59.023 DEBUG:teuthology.orchestra.run.smithi035:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T09:38:59.037 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:38:59.037 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T09:38:59.062 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T09:38:59.075 INFO:teuthology.run_tasks:Running task ceph... 2023-01-25T09:38:59.146 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-01-25T09:38:59.146 DEBUG:teuthology.orchestra.run.smithi035:> sudo chmod 777 /var/log/ceph 2023-01-25T09:38:59.149 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2023-01-25T09:38:59.165 INFO:tasks.ceph:Disabling ceph logrotate... 2023-01-25T09:38:59.165 DEBUG:teuthology.orchestra.run.smithi035:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T09:38:59.167 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T09:38:59.226 INFO:tasks.ceph:Creating extra log directories... 2023-01-25T09:38:59.227 DEBUG:teuthology.orchestra.run.smithi035:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T09:38:59.229 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T09:38:59.257 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-01-25T09:38:59.258 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore queue throttle high multiple': 2, 'filestore queue throttle max multiple': 10, 'journal throttle high multiple': 2, 'journal throttle max multiple': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 9, 'osd max markdown count': 1000, 'osd max scrubs': 3, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2023-01-25T09:38:59.258 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137182', 'branch': 'wip-yuri6-testing-2023-01-24-0746', 'description': 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps}', 'email': 'yweinstein@radhat.com', 'first_in_suite': False, 'job_id': '7137182', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}, {'volumes': {'size': 50}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2023-01-24-0746'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore queue throttle high multiple': 2, 'filestore queue throttle max multiple': 10, 'journal throttle high multiple': 2, 'journal throttle max multiple': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 9, 'osd max markdown count': 1000, 'osd max scrubs': 3, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'mon_bind_msgr2': False, 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4}, 'workunit': {'branch': 'wip-yuri6-testing-2023-01-24-0746', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2023-01-24-0746', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'targets': {'smithi035.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=', 'smithi138.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore queue throttle high multiple': 2, 'filestore queue throttle max multiple': 10, 'journal throttle high multiple': 2, 'journal throttle max multiple': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 9, 'osd max markdown count': 1000, 'osd max scrubs': 3, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'mon_bind_msgr2': False, 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'cluster': 'ceph'}}, {'thrashosds': {'chance_pgnum_grow': 3, 'chance_pgpnum_fix': 1, 'timeout': 1200}}, {'exec': {'client.0': ['sudo ceph osd pool create base 4', 'sudo ceph osd pool application enable base rados', 'sudo ceph osd pool create cache 4', 'sudo ceph osd tier add base cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay base cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 3600', 'sudo ceph osd pool set cache target_max_objects 250', 'sudo ceph osd pool set cache min_read_recency_for_promote 2']}}, {'rados': {'clients': ['client.0'], 'objects': 500, 'op_weights': {'cache_evict': 50, 'cache_flush': 50, 'cache_try_flush': 50, 'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000, 'pools': ['base']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8e1bba12e584b7ae912e92e94afe9c075ab51fa3', 'timestamp': '2023-01-24_22:27:30', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.17735'} 2023-01-25T09:38:59.259 DEBUG:teuthology.orchestra.run.smithi035:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T09:38:59.261 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T09:38:59.292 DEBUG:teuthology.orchestra.run.smithi035:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T09:38:59.311 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T09:38:59.329 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:38:59.329 DEBUG:teuthology.orchestra.run.smithi035:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T09:38:59.335 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T09:38:59.336 DEBUG:teuthology.orchestra.run.smithi035:> stat /dev/vg_nvme/lv_1 2023-01-25T09:38:59.342 INFO:teuthology.orchestra.run.smithi035.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T09:38:59.342 INFO:teuthology.orchestra.run.smithi035.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:38:59.342 INFO:teuthology.orchestra.run.smithi035.stdout:Device: 6h/6d Inode: 360 Links: 1 2023-01-25T09:38:59.342 INFO:teuthology.orchestra.run.smithi035.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:38:59.342 INFO:teuthology.orchestra.run.smithi035.stdout:Access: 2023-01-25 09:35:29.490394904 +0000 2023-01-25T09:38:59.343 INFO:teuthology.orchestra.run.smithi035.stdout:Modify: 2023-01-25 09:35:29.174402179 +0000 2023-01-25T09:38:59.343 INFO:teuthology.orchestra.run.smithi035.stdout:Change: 2023-01-25 09:35:29.174402179 +0000 2023-01-25T09:38:59.343 INFO:teuthology.orchestra.run.smithi035.stdout: Birth: - 2023-01-25T09:38:59.343 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T09:38:59.400 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records in 2023-01-25T09:38:59.400 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records out 2023-01-25T09:38:59.400 INFO:teuthology.orchestra.run.smithi035.stderr:512 bytes copied, 0.000429344 s, 1.2 MB/s 2023-01-25T09:38:59.401 DEBUG:teuthology.orchestra.run.smithi035:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T09:38:59.409 DEBUG:teuthology.orchestra.run.smithi035:> stat /dev/vg_nvme/lv_2 2023-01-25T09:38:59.415 INFO:teuthology.orchestra.run.smithi035.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T09:38:59.415 INFO:teuthology.orchestra.run.smithi035.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:38:59.415 INFO:teuthology.orchestra.run.smithi035.stdout:Device: 6h/6d Inode: 367 Links: 1 2023-01-25T09:38:59.416 INFO:teuthology.orchestra.run.smithi035.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:38:59.416 INFO:teuthology.orchestra.run.smithi035.stdout:Access: 2023-01-25 09:35:30.022382659 +0000 2023-01-25T09:38:59.416 INFO:teuthology.orchestra.run.smithi035.stdout:Modify: 2023-01-25 09:35:29.734389289 +0000 2023-01-25T09:38:59.416 INFO:teuthology.orchestra.run.smithi035.stdout:Change: 2023-01-25 09:35:29.734389289 +0000 2023-01-25T09:38:59.416 INFO:teuthology.orchestra.run.smithi035.stdout: Birth: - 2023-01-25T09:38:59.417 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T09:38:59.470 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records in 2023-01-25T09:38:59.471 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records out 2023-01-25T09:38:59.471 INFO:teuthology.orchestra.run.smithi035.stderr:512 bytes copied, 0.000402414 s, 1.3 MB/s 2023-01-25T09:38:59.472 DEBUG:teuthology.orchestra.run.smithi035:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T09:38:59.481 DEBUG:teuthology.orchestra.run.smithi035:> stat /dev/vg_nvme/lv_3 2023-01-25T09:38:59.488 INFO:teuthology.orchestra.run.smithi035.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T09:38:59.488 INFO:teuthology.orchestra.run.smithi035.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:38:59.489 INFO:teuthology.orchestra.run.smithi035.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-01-25T09:38:59.489 INFO:teuthology.orchestra.run.smithi035.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:38:59.489 INFO:teuthology.orchestra.run.smithi035.stdout:Access: 2023-01-25 09:35:30.542370689 +0000 2023-01-25T09:38:59.489 INFO:teuthology.orchestra.run.smithi035.stdout:Modify: 2023-01-25 09:35:30.254377320 +0000 2023-01-25T09:38:59.489 INFO:teuthology.orchestra.run.smithi035.stdout:Change: 2023-01-25 09:35:30.254377320 +0000 2023-01-25T09:38:59.490 INFO:teuthology.orchestra.run.smithi035.stdout: Birth: - 2023-01-25T09:38:59.490 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T09:38:59.543 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records in 2023-01-25T09:38:59.544 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records out 2023-01-25T09:38:59.544 INFO:teuthology.orchestra.run.smithi035.stderr:512 bytes copied, 0.000416788 s, 1.2 MB/s 2023-01-25T09:38:59.545 DEBUG:teuthology.orchestra.run.smithi035:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T09:38:59.553 DEBUG:teuthology.orchestra.run.smithi035:> stat /dev/vg_nvme/lv_4 2023-01-25T09:38:59.559 INFO:teuthology.orchestra.run.smithi035.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T09:38:59.559 INFO:teuthology.orchestra.run.smithi035.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:38:59.559 INFO:teuthology.orchestra.run.smithi035.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-01-25T09:38:59.559 INFO:teuthology.orchestra.run.smithi035.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:38:59.560 INFO:teuthology.orchestra.run.smithi035.stdout:Access: 2023-01-25 09:35:31.038359272 +0000 2023-01-25T09:38:59.560 INFO:teuthology.orchestra.run.smithi035.stdout:Modify: 2023-01-25 09:35:30.758365718 +0000 2023-01-25T09:38:59.560 INFO:teuthology.orchestra.run.smithi035.stdout:Change: 2023-01-25 09:35:30.758365718 +0000 2023-01-25T09:38:59.560 INFO:teuthology.orchestra.run.smithi035.stdout: Birth: - 2023-01-25T09:38:59.561 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T09:38:59.616 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records in 2023-01-25T09:38:59.616 INFO:teuthology.orchestra.run.smithi035.stderr:1+0 records out 2023-01-25T09:38:59.616 INFO:teuthology.orchestra.run.smithi035.stderr:512 bytes copied, 0.000426151 s, 1.2 MB/s 2023-01-25T09:38:59.617 DEBUG:teuthology.orchestra.run.smithi035:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T09:38:59.624 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:38:59.625 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:38:59.625 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T09:38:59.632 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T09:38:59.633 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2023-01-25T09:38:59.640 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T09:38:59.640 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:38:59.641 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 358 Links: 1 2023-01-25T09:38:59.641 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:38:59.641 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2023-01-25 09:35:31.332635675 +0000 2023-01-25T09:38:59.641 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2023-01-25 09:35:31.052642119 +0000 2023-01-25T09:38:59.642 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2023-01-25 09:35:31.052642119 +0000 2023-01-25T09:38:59.642 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2023-01-25T09:38:59.642 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T09:38:59.653 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2023-01-25T09:38:59.653 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2023-01-25T09:38:59.654 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000408725 s, 1.3 MB/s 2023-01-25T09:38:59.655 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T09:38:59.705 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2023-01-25T09:38:59.712 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T09:38:59.712 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:38:59.713 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-01-25T09:38:59.713 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:38:59.713 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2023-01-25 09:35:31.828624261 +0000 2023-01-25T09:38:59.713 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2023-01-25 09:35:31.552630612 +0000 2023-01-25T09:38:59.713 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2023-01-25 09:35:31.552630612 +0000 2023-01-25T09:38:59.713 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2023-01-25T09:38:59.714 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T09:38:59.727 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2023-01-25T09:38:59.727 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2023-01-25T09:38:59.728 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000402815 s, 1.3 MB/s 2023-01-25T09:38:59.729 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T09:38:59.777 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2023-01-25T09:38:59.784 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T09:38:59.785 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:38:59.785 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-01-25T09:38:59.785 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:38:59.785 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2023-01-25 09:35:32.340612478 +0000 2023-01-25T09:38:59.785 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2023-01-25 09:35:32.040619382 +0000 2023-01-25T09:38:59.785 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2023-01-25 09:35:32.040619382 +0000 2023-01-25T09:38:59.786 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2023-01-25T09:38:59.786 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T09:38:59.797 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2023-01-25T09:38:59.798 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2023-01-25T09:38:59.798 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000368746 s, 1.4 MB/s 2023-01-25T09:38:59.799 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T09:38:59.849 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2023-01-25T09:38:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T09:38:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:38:59.857 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 6h/6d Inode: 374 Links: 1 2023-01-25T09:38:59.857 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:38:59.858 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2023-01-25 09:35:32.876600145 +0000 2023-01-25T09:38:59.858 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2023-01-25 09:35:32.580606956 +0000 2023-01-25T09:38:59.858 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2023-01-25 09:35:32.580606956 +0000 2023-01-25T09:38:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2023-01-25T09:38:59.858 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T09:38:59.871 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2023-01-25T09:38:59.872 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2023-01-25T09:38:59.872 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000405111 s, 1.3 MB/s 2023-01-25T09:38:59.873 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T09:38:59.925 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:38:59.926 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi035.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T09:38:59.926 INFO:tasks.ceph:Generating config... 2023-01-25T09:38:59.927 INFO:tasks.ceph:[osd] debug monc = 20 2023-01-25T09:38:59.928 INFO:tasks.ceph:[osd] bdev async discard = True 2023-01-25T09:38:59.928 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-01-25T09:38:59.928 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2023-01-25T09:38:59.929 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-01-25T09:38:59.929 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-01-25T09:38:59.929 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-01-25T09:38:59.929 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-01-25T09:38:59.930 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-01-25T09:38:59.930 INFO:tasks.ceph:[osd] debug ms = 1 2023-01-25T09:38:59.930 INFO:tasks.ceph:[osd] debug osd = 20 2023-01-25T09:38:59.930 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-01-25T09:38:59.931 INFO:tasks.ceph:[osd] filestore queue throttle high multiple = 2 2023-01-25T09:38:59.931 INFO:tasks.ceph:[osd] filestore queue throttle max multiple = 10 2023-01-25T09:38:59.931 INFO:tasks.ceph:[osd] journal throttle high multiple = 2 2023-01-25T09:38:59.931 INFO:tasks.ceph:[osd] journal throttle max multiple = 10 2023-01-25T09:38:59.932 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-01-25T09:38:59.932 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-01-25T09:38:59.932 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-01-25T09:38:59.932 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-01-25T09:38:59.933 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-01-25T09:38:59.933 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-01-25T09:38:59.933 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-01-25T09:38:59.933 INFO:tasks.ceph:[osd] osd max backfills = 9 2023-01-25T09:38:59.934 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-01-25T09:38:59.934 INFO:tasks.ceph:[osd] osd max scrubs = 3 2023-01-25T09:38:59.934 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-01-25T09:38:59.934 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-01-25T09:38:59.935 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-01-25T09:38:59.935 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-01-25T09:38:59.935 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2023-01-25T09:38:59.935 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2023-01-25T09:38:59.936 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-01-25T09:38:59.936 INFO:tasks.ceph:[osd] osd_max_pg_log_entries = 3000 2023-01-25T09:38:59.936 INFO:tasks.ceph:[osd] osd_min_pg_log_entries = 3000 2023-01-25T09:38:59.937 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-01-25T09:38:59.937 INFO:tasks.ceph:[global] mon election default strategy = 3 2023-01-25T09:38:59.937 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-01-25T09:38:59.938 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2023-01-25T09:38:59.938 INFO:tasks.ceph:[global] ms tcp read timeout = 5 2023-01-25T09:38:59.938 INFO:tasks.ceph:[global] ms type = async 2023-01-25T09:38:59.939 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 2 2023-01-25T09:38:59.939 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 1 2023-01-25T09:38:59.939 INFO:tasks.ceph:[global] osd_pg_log_trim_min = 0 2023-01-25T09:38:59.939 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2023-01-25T09:38:59.940 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2023-01-25T09:38:59.940 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-01-25T09:38:59.940 INFO:tasks.ceph:[mgr] debug ms = 1 2023-01-25T09:38:59.940 INFO:tasks.ceph:[mon] debug mon = 20 2023-01-25T09:38:59.941 INFO:tasks.ceph:[mon] debug ms = 1 2023-01-25T09:38:59.941 INFO:tasks.ceph:[mon] debug paxos = 20 2023-01-25T09:38:59.941 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-01-25T09:38:59.941 INFO:tasks.ceph:Setting up mon.a... 2023-01-25T09:38:59.942 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-01-25T09:38:59.983 INFO:teuthology.orchestra.run.smithi035.stdout:creating /etc/ceph/ceph.keyring 2023-01-25T09:38:59.996 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-01-25T09:39:00.078 DEBUG:teuthology.orchestra.run.smithi035:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T09:39:00.094 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.35:6789]'), ('mon.c', '[v1:172.21.15.35:6790]'), ('mon.b', '[v1:172.21.15.138:6789]')] 2023-01-25T09:39:00.095 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.35:6789],[v1:172.21.15.35:6790],[v1:172.21.15.138:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore queue throttle high multiple': 2, 'filestore queue throttle max multiple': 10, 'journal throttle high multiple': 2, 'journal throttle max multiple': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 9, 'osd max markdown count': 1000, 'osd max scrubs': 3, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-01-25T09:39:00.096 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:00.096 DEBUG:teuthology.orchestra.run.smithi035:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T09:39:00.103 DEBUG:teuthology.orchestra.run.smithi035:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.35:6789]' --addv c '[v1:172.21.15.35:6790]' --addv b '[v1:172.21.15.138:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:00.193 INFO:teuthology.orchestra.run.smithi035.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:00.193 INFO:teuthology.orchestra.run.smithi035.stdout:monmaptool: generated fsid 97131e4b-ba28-4ab8-a3d7-d027cd4303dd 2023-01-25T09:39:00.193 INFO:teuthology.orchestra.run.smithi035.stdout:setting min_mon_release = pacific 2023-01-25T09:39:00.194 INFO:teuthology.orchestra.run.smithi035.stdout:epoch 0 2023-01-25T09:39:00.194 INFO:teuthology.orchestra.run.smithi035.stdout:fsid 97131e4b-ba28-4ab8-a3d7-d027cd4303dd 2023-01-25T09:39:00.194 INFO:teuthology.orchestra.run.smithi035.stdout:last_changed 2023-01-25T09:39:00.189566+0000 2023-01-25T09:39:00.194 INFO:teuthology.orchestra.run.smithi035.stdout:created 2023-01-25T09:39:00.189566+0000 2023-01-25T09:39:00.194 INFO:teuthology.orchestra.run.smithi035.stdout:min_mon_release 16 (pacific) 2023-01-25T09:39:00.195 INFO:teuthology.orchestra.run.smithi035.stdout:election_strategy: 3 2023-01-25T09:39:00.195 INFO:teuthology.orchestra.run.smithi035.stdout:0: v1:172.21.15.35:6789/0 mon.a 2023-01-25T09:39:00.195 INFO:teuthology.orchestra.run.smithi035.stdout:1: v1:172.21.15.138:6789/0 mon.b 2023-01-25T09:39:00.195 INFO:teuthology.orchestra.run.smithi035.stdout:2: v1:172.21.15.35:6790/0 mon.c 2023-01-25T09:39:00.195 INFO:teuthology.orchestra.run.smithi035.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-01-25T09:39:00.197 DEBUG:teuthology.orchestra.run.smithi035:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T09:39:00.201 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 97131e4b-ba28-4ab8-a3d7-d027cd4303dd... 2023-01-25T09:39:00.202 DEBUG:teuthology.orchestra.run.smithi035:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T09:39:00.205 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T09:39:00.234 INFO:teuthology.orchestra.run.smithi035.stdout:[global] 2023-01-25T09:39:00.234 INFO:teuthology.orchestra.run.smithi035.stdout: chdir = "" 2023-01-25T09:39:00.234 INFO:teuthology.orchestra.run.smithi035.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T09:39:00.234 INFO:teuthology.orchestra.run.smithi035.stdout: auth supported = cephx 2023-01-25T09:39:00.235 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.235 INFO:teuthology.orchestra.run.smithi035.stdout: filestore xattr use omap = true 2023-01-25T09:39:00.235 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.235 INFO:teuthology.orchestra.run.smithi035.stdout: mon clock drift allowed = 1.000 2023-01-25T09:39:00.235 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.236 INFO:teuthology.orchestra.run.smithi035.stdout: osd crush chooseleaf type = 0 2023-01-25T09:39:00.236 INFO:teuthology.orchestra.run.smithi035.stdout: auth debug = true 2023-01-25T09:39:00.236 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.236 INFO:teuthology.orchestra.run.smithi035.stdout: ms die on old message = true 2023-01-25T09:39:00.236 INFO:teuthology.orchestra.run.smithi035.stdout: ms die on bug = true 2023-01-25T09:39:00.237 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.237 INFO:teuthology.orchestra.run.smithi035.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T09:39:00.237 INFO:teuthology.orchestra.run.smithi035.stdout: mon pg warn max object skew = 0 2023-01-25T09:39:00.237 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.237 INFO:teuthology.orchestra.run.smithi035.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T09:39:00.238 INFO:teuthology.orchestra.run.smithi035.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T09:39:00.238 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.238 INFO:teuthology.orchestra.run.smithi035.stdout: osd pool default size = 2 2023-01-25T09:39:00.238 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.238 INFO:teuthology.orchestra.run.smithi035.stdout: mon osd allow primary affinity = true 2023-01-25T09:39:00.239 INFO:teuthology.orchestra.run.smithi035.stdout: mon osd allow pg remap = true 2023-01-25T09:39:00.239 INFO:teuthology.orchestra.run.smithi035.stdout: mon warn on legacy crush tunables = false 2023-01-25T09:39:00.239 INFO:teuthology.orchestra.run.smithi035.stdout: mon warn on crush straw calc version zero = false 2023-01-25T09:39:00.239 INFO:teuthology.orchestra.run.smithi035.stdout: mon warn on no sortbitwise = false 2023-01-25T09:39:00.239 INFO:teuthology.orchestra.run.smithi035.stdout: mon warn on osd down out interval zero = false 2023-01-25T09:39:00.240 INFO:teuthology.orchestra.run.smithi035.stdout: mon warn on too few osds = false 2023-01-25T09:39:00.240 INFO:teuthology.orchestra.run.smithi035.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T09:39:00.240 INFO:teuthology.orchestra.run.smithi035.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T09:39:00.240 INFO:teuthology.orchestra.run.smithi035.stdout: mon_allow_pool_size_one = true 2023-01-25T09:39:00.240 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.241 INFO:teuthology.orchestra.run.smithi035.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T09:39:00.241 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.241 INFO:teuthology.orchestra.run.smithi035.stdout: osd default data pool replay window = 5 2023-01-25T09:39:00.241 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.241 INFO:teuthology.orchestra.run.smithi035.stdout: mon allow pool delete = true 2023-01-25T09:39:00.242 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.242 INFO:teuthology.orchestra.run.smithi035.stdout: mon cluster log file level = debug 2023-01-25T09:39:00.242 INFO:teuthology.orchestra.run.smithi035.stdout: debug asserts on shutdown = true 2023-01-25T09:39:00.242 INFO:teuthology.orchestra.run.smithi035.stdout: mon health detail to clog = false 2023-01-25T09:39:00.242 INFO:teuthology.orchestra.run.smithi035.stdout: mon host = "[v1:172.21.15.35:6789],[v1:172.21.15.35:6790],[v1:172.21.15.138:6789]" 2023-01-25T09:39:00.243 INFO:teuthology.orchestra.run.smithi035.stdout: mon client directed command retry = 5 2023-01-25T09:39:00.243 INFO:teuthology.orchestra.run.smithi035.stdout: mon election default strategy = 3 2023-01-25T09:39:00.243 INFO:teuthology.orchestra.run.smithi035.stdout: ms bind msgr2 = False 2023-01-25T09:39:00.243 INFO:teuthology.orchestra.run.smithi035.stdout: ms inject socket failures = 2500 2023-01-25T09:39:00.243 INFO:teuthology.orchestra.run.smithi035.stdout: ms tcp read timeout = 5 2023-01-25T09:39:00.244 INFO:teuthology.orchestra.run.smithi035.stdout: ms type = async 2023-01-25T09:39:00.244 INFO:teuthology.orchestra.run.smithi035.stdout: osd_max_pg_log_entries = 2 2023-01-25T09:39:00.244 INFO:teuthology.orchestra.run.smithi035.stdout: osd_min_pg_log_entries = 1 2023-01-25T09:39:00.244 INFO:teuthology.orchestra.run.smithi035.stdout: osd_pg_log_trim_min = 0 2023-01-25T09:39:00.244 INFO:teuthology.orchestra.run.smithi035.stdout: osd_pool_default_min_size = 2 2023-01-25T09:39:00.245 INFO:teuthology.orchestra.run.smithi035.stdout: osd_pool_default_size = 3 2023-01-25T09:39:00.245 INFO:teuthology.orchestra.run.smithi035.stdout: fsid = 97131e4b-ba28-4ab8-a3d7-d027cd4303dd 2023-01-25T09:39:00.245 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.245 INFO:teuthology.orchestra.run.smithi035.stdout:[osd] 2023-01-25T09:39:00.245 INFO:teuthology.orchestra.run.smithi035.stdout: osd journal size = 100 2023-01-25T09:39:00.246 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.246 INFO:teuthology.orchestra.run.smithi035.stdout: osd scrub load threshold = 5.0 2023-01-25T09:39:00.246 INFO:teuthology.orchestra.run.smithi035.stdout: osd scrub max interval = 120 2023-01-25T09:39:00.246 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.246 INFO:teuthology.orchestra.run.smithi035.stdout: osd recover clone overlap = true 2023-01-25T09:39:00.247 INFO:teuthology.orchestra.run.smithi035.stdout: osd recovery max chunk = 1048576 2023-01-25T09:39:00.247 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.247 INFO:teuthology.orchestra.run.smithi035.stdout: osd debug shutdown = true 2023-01-25T09:39:00.247 INFO:teuthology.orchestra.run.smithi035.stdout: osd debug op order = true 2023-01-25T09:39:00.247 INFO:teuthology.orchestra.run.smithi035.stdout: osd debug verify stray on activate = true 2023-01-25T09:39:00.248 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.248 INFO:teuthology.orchestra.run.smithi035.stdout: osd open classes on start = true 2023-01-25T09:39:00.248 INFO:teuthology.orchestra.run.smithi035.stdout: osd debug pg log writeout = true 2023-01-25T09:39:00.248 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.249 INFO:teuthology.orchestra.run.smithi035.stdout: osd deep scrub update digest min age = 30 2023-01-25T09:39:00.249 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.249 INFO:teuthology.orchestra.run.smithi035.stdout: osd map max advance = 10 2023-01-25T09:39:00.249 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.249 INFO:teuthology.orchestra.run.smithi035.stdout: journal zero on create = true 2023-01-25T09:39:00.250 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.250 INFO:teuthology.orchestra.run.smithi035.stdout: filestore ondisk finisher threads = 3 2023-01-25T09:39:00.250 INFO:teuthology.orchestra.run.smithi035.stdout: filestore apply finisher threads = 3 2023-01-25T09:39:00.250 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.250 INFO:teuthology.orchestra.run.smithi035.stdout: bdev debug aio = true 2023-01-25T09:39:00.251 INFO:teuthology.orchestra.run.smithi035.stdout: osd debug misdirected ops = true 2023-01-25T09:39:00.251 INFO:teuthology.orchestra.run.smithi035.stdout: debug monc = 20 2023-01-25T09:39:00.251 INFO:teuthology.orchestra.run.smithi035.stdout: bdev async discard = True 2023-01-25T09:39:00.251 INFO:teuthology.orchestra.run.smithi035.stdout: bdev enable discard = True 2023-01-25T09:39:00.251 INFO:teuthology.orchestra.run.smithi035.stdout: bluestore allocator = stupid 2023-01-25T09:39:00.252 INFO:teuthology.orchestra.run.smithi035.stdout: bluestore block size = 96636764160 2023-01-25T09:39:00.252 INFO:teuthology.orchestra.run.smithi035.stdout: bluestore fsck on mount = True 2023-01-25T09:39:00.252 INFO:teuthology.orchestra.run.smithi035.stdout: bluestore zero block detection = True 2023-01-25T09:39:00.252 INFO:teuthology.orchestra.run.smithi035.stdout: debug bluefs = 20 2023-01-25T09:39:00.253 INFO:teuthology.orchestra.run.smithi035.stdout: debug bluestore = 20 2023-01-25T09:39:00.253 INFO:teuthology.orchestra.run.smithi035.stdout: debug ms = 1 2023-01-25T09:39:00.253 INFO:teuthology.orchestra.run.smithi035.stdout: debug osd = 20 2023-01-25T09:39:00.253 INFO:teuthology.orchestra.run.smithi035.stdout: debug rocksdb = 10 2023-01-25T09:39:00.253 INFO:teuthology.orchestra.run.smithi035.stdout: filestore queue throttle high multiple = 2 2023-01-25T09:39:00.254 INFO:teuthology.orchestra.run.smithi035.stdout: filestore queue throttle max multiple = 10 2023-01-25T09:39:00.254 INFO:teuthology.orchestra.run.smithi035.stdout: journal throttle high multiple = 2 2023-01-25T09:39:00.254 INFO:teuthology.orchestra.run.smithi035.stdout: journal throttle max multiple = 10 2023-01-25T09:39:00.254 INFO:teuthology.orchestra.run.smithi035.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T09:39:00.254 INFO:teuthology.orchestra.run.smithi035.stdout: mon osd full ratio = 0.9 2023-01-25T09:39:00.254 INFO:teuthology.orchestra.run.smithi035.stdout: mon osd nearfull ratio = 0.8 2023-01-25T09:39:00.255 INFO:teuthology.orchestra.run.smithi035.stdout: osd blocked scrub grace period = 3600 2023-01-25T09:39:00.255 INFO:teuthology.orchestra.run.smithi035.stdout: osd debug verify cached snaps = True 2023-01-25T09:39:00.255 INFO:teuthology.orchestra.run.smithi035.stdout: osd debug verify missing on start = True 2023-01-25T09:39:00.255 INFO:teuthology.orchestra.run.smithi035.stdout: osd failsafe full ratio = 0.95 2023-01-25T09:39:00.255 INFO:teuthology.orchestra.run.smithi035.stdout: osd max backfills = 9 2023-01-25T09:39:00.256 INFO:teuthology.orchestra.run.smithi035.stdout: osd max markdown count = 1000 2023-01-25T09:39:00.256 INFO:teuthology.orchestra.run.smithi035.stdout: osd max scrubs = 3 2023-01-25T09:39:00.256 INFO:teuthology.orchestra.run.smithi035.stdout: osd mclock override recovery settings = True 2023-01-25T09:39:00.256 INFO:teuthology.orchestra.run.smithi035.stdout: osd objectstore = bluestore 2023-01-25T09:39:00.257 INFO:teuthology.orchestra.run.smithi035.stdout: osd op queue = debug_random 2023-01-25T09:39:00.257 INFO:teuthology.orchestra.run.smithi035.stdout: osd op queue cut off = debug_random 2023-01-25T09:39:00.257 INFO:teuthology.orchestra.run.smithi035.stdout: osd scrub min interval = 60 2023-01-25T09:39:00.257 INFO:teuthology.orchestra.run.smithi035.stdout: osd shutdown pgref assert = True 2023-01-25T09:39:00.257 INFO:teuthology.orchestra.run.smithi035.stdout: osd_max_pg_log_entries = 3000 2023-01-25T09:39:00.257 INFO:teuthology.orchestra.run.smithi035.stdout: osd_min_pg_log_entries = 3000 2023-01-25T09:39:00.258 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.258 INFO:teuthology.orchestra.run.smithi035.stdout:[mgr] 2023-01-25T09:39:00.258 INFO:teuthology.orchestra.run.smithi035.stdout: debug ms = 1 2023-01-25T09:39:00.258 INFO:teuthology.orchestra.run.smithi035.stdout: debug mgr = 20 2023-01-25T09:39:00.258 INFO:teuthology.orchestra.run.smithi035.stdout: debug mon = 20 2023-01-25T09:39:00.259 INFO:teuthology.orchestra.run.smithi035.stdout: debug auth = 20 2023-01-25T09:39:00.259 INFO:teuthology.orchestra.run.smithi035.stdout: mon reweight min pgs per osd = 4 2023-01-25T09:39:00.259 INFO:teuthology.orchestra.run.smithi035.stdout: mon reweight min bytes per osd = 10 2023-01-25T09:39:00.259 INFO:teuthology.orchestra.run.smithi035.stdout: mgr/telemetry/nag = false 2023-01-25T09:39:00.259 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.259 INFO:teuthology.orchestra.run.smithi035.stdout:[mon] 2023-01-25T09:39:00.260 INFO:teuthology.orchestra.run.smithi035.stdout: debug ms = 1 2023-01-25T09:39:00.260 INFO:teuthology.orchestra.run.smithi035.stdout: debug mon = 20 2023-01-25T09:39:00.260 INFO:teuthology.orchestra.run.smithi035.stdout: debug paxos = 20 2023-01-25T09:39:00.260 INFO:teuthology.orchestra.run.smithi035.stdout: debug auth = 20 2023-01-25T09:39:00.260 INFO:teuthology.orchestra.run.smithi035.stdout: mon data avail warn = 5 2023-01-25T09:39:00.261 INFO:teuthology.orchestra.run.smithi035.stdout: mon mgr mkfs grace = 240 2023-01-25T09:39:00.261 INFO:teuthology.orchestra.run.smithi035.stdout: mon reweight min pgs per osd = 4 2023-01-25T09:39:00.261 INFO:teuthology.orchestra.run.smithi035.stdout: mon osd reporter subtree level = osd 2023-01-25T09:39:00.261 INFO:teuthology.orchestra.run.smithi035.stdout: mon osd prime pg temp = true 2023-01-25T09:39:00.261 INFO:teuthology.orchestra.run.smithi035.stdout: mon reweight min bytes per osd = 10 2023-01-25T09:39:00.262 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.262 INFO:teuthology.orchestra.run.smithi035.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T09:39:00.262 INFO:teuthology.orchestra.run.smithi035.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T09:39:00.262 INFO:teuthology.orchestra.run.smithi035.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T09:39:00.262 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.263 INFO:teuthology.orchestra.run.smithi035.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T09:39:00.263 INFO:teuthology.orchestra.run.smithi035.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T09:39:00.263 INFO:teuthology.orchestra.run.smithi035.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T09:39:00.263 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.263 INFO:teuthology.orchestra.run.smithi035.stdout: # 1m isn't quite enough 2023-01-25T09:39:00.264 INFO:teuthology.orchestra.run.smithi035.stdout: mon_down_mkfs_grace = 2m 2023-01-25T09:39:00.264 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.264 INFO:teuthology.orchestra.run.smithi035.stdout: mon_warn_on_filestore_osds = false 2023-01-25T09:39:00.264 INFO:teuthology.orchestra.run.smithi035.stdout: mon scrub interval = 300 2023-01-25T09:39:00.264 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:00.265 INFO:teuthology.orchestra.run.smithi035.stdout:[client] 2023-01-25T09:39:00.265 INFO:teuthology.orchestra.run.smithi035.stdout: rgw cache enabled = true 2023-01-25T09:39:00.265 INFO:teuthology.orchestra.run.smithi035.stdout: rgw enable ops log = true 2023-01-25T09:39:00.265 INFO:teuthology.orchestra.run.smithi035.stdout: rgw enable usage log = true 2023-01-25T09:39:00.265 INFO:teuthology.orchestra.run.smithi035.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T09:39:00.266 INFO:teuthology.orchestra.run.smithi035.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T09:39:00.266 INFO:teuthology.orchestra.run.smithi035.stdout:[mon.a] 2023-01-25T09:39:00.266 INFO:teuthology.orchestra.run.smithi035.stdout:[mon.c] 2023-01-25T09:39:00.266 INFO:teuthology.orchestra.run.smithi035.stdout:[mon.b] 2023-01-25T09:39:00.268 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2023-01-25T09:39:00.268 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2023-01-25T09:39:00.268 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T09:39:00.269 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2023-01-25T09:39:00.269 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.269 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2023-01-25T09:39:00.269 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.269 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2023-01-25T09:39:00.269 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.270 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2023-01-25T09:39:00.270 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2023-01-25T09:39:00.270 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.270 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2023-01-25T09:39:00.270 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2023-01-25T09:39:00.271 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.271 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T09:39:00.271 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2023-01-25T09:39:00.271 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.271 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T09:39:00.272 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T09:39:00.272 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.272 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2023-01-25T09:39:00.272 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.273 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2023-01-25T09:39:00.273 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2023-01-25T09:39:00.273 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2023-01-25T09:39:00.273 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2023-01-25T09:39:00.273 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2023-01-25T09:39:00.274 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2023-01-25T09:39:00.274 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2023-01-25T09:39:00.274 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T09:39:00.274 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T09:39:00.274 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2023-01-25T09:39:00.275 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.275 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T09:39:00.275 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.275 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2023-01-25T09:39:00.275 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.276 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2023-01-25T09:39:00.276 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.276 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2023-01-25T09:39:00.276 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2023-01-25T09:39:00.276 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2023-01-25T09:39:00.277 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "[v1:172.21.15.35:6789],[v1:172.21.15.35:6790],[v1:172.21.15.138:6789]" 2023-01-25T09:39:00.277 INFO:teuthology.orchestra.run.smithi138.stdout: mon client directed command retry = 5 2023-01-25T09:39:00.277 INFO:teuthology.orchestra.run.smithi138.stdout: mon election default strategy = 3 2023-01-25T09:39:00.277 INFO:teuthology.orchestra.run.smithi138.stdout: ms bind msgr2 = False 2023-01-25T09:39:00.277 INFO:teuthology.orchestra.run.smithi138.stdout: ms inject socket failures = 2500 2023-01-25T09:39:00.278 INFO:teuthology.orchestra.run.smithi138.stdout: ms tcp read timeout = 5 2023-01-25T09:39:00.278 INFO:teuthology.orchestra.run.smithi138.stdout: ms type = async 2023-01-25T09:39:00.278 INFO:teuthology.orchestra.run.smithi138.stdout: osd_max_pg_log_entries = 2 2023-01-25T09:39:00.278 INFO:teuthology.orchestra.run.smithi138.stdout: osd_min_pg_log_entries = 1 2023-01-25T09:39:00.278 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pg_log_trim_min = 0 2023-01-25T09:39:00.279 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_min_size = 2 2023-01-25T09:39:00.279 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_size = 3 2023-01-25T09:39:00.279 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = 97131e4b-ba28-4ab8-a3d7-d027cd4303dd 2023-01-25T09:39:00.279 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.279 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2023-01-25T09:39:00.279 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2023-01-25T09:39:00.280 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.280 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2023-01-25T09:39:00.280 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 120 2023-01-25T09:39:00.280 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.280 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2023-01-25T09:39:00.281 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2023-01-25T09:39:00.281 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.281 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2023-01-25T09:39:00.281 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2023-01-25T09:39:00.281 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2023-01-25T09:39:00.282 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.282 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2023-01-25T09:39:00.282 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2023-01-25T09:39:00.282 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.283 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2023-01-25T09:39:00.283 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.283 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2023-01-25T09:39:00.283 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.283 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2023-01-25T09:39:00.283 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.284 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2023-01-25T09:39:00.284 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2023-01-25T09:39:00.284 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.284 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2023-01-25T09:39:00.284 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2023-01-25T09:39:00.285 INFO:teuthology.orchestra.run.smithi138.stdout: debug monc = 20 2023-01-25T09:39:00.285 INFO:teuthology.orchestra.run.smithi138.stdout: bdev async discard = True 2023-01-25T09:39:00.285 INFO:teuthology.orchestra.run.smithi138.stdout: bdev enable discard = True 2023-01-25T09:39:00.285 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore allocator = stupid 2023-01-25T09:39:00.285 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2023-01-25T09:39:00.286 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2023-01-25T09:39:00.286 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore zero block detection = True 2023-01-25T09:39:00.286 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 20 2023-01-25T09:39:00.286 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 20 2023-01-25T09:39:00.286 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-01-25T09:39:00.287 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2023-01-25T09:39:00.287 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 10 2023-01-25T09:39:00.287 INFO:teuthology.orchestra.run.smithi138.stdout: filestore queue throttle high multiple = 2 2023-01-25T09:39:00.287 INFO:teuthology.orchestra.run.smithi138.stdout: filestore queue throttle max multiple = 10 2023-01-25T09:39:00.287 INFO:teuthology.orchestra.run.smithi138.stdout: journal throttle high multiple = 2 2023-01-25T09:39:00.288 INFO:teuthology.orchestra.run.smithi138.stdout: journal throttle max multiple = 10 2023-01-25T09:39:00.288 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T09:39:00.288 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2023-01-25T09:39:00.288 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2023-01-25T09:39:00.288 INFO:teuthology.orchestra.run.smithi138.stdout: osd blocked scrub grace period = 3600 2023-01-25T09:39:00.289 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify cached snaps = True 2023-01-25T09:39:00.289 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify missing on start = True 2023-01-25T09:39:00.289 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2023-01-25T09:39:00.289 INFO:teuthology.orchestra.run.smithi138.stdout: osd max backfills = 9 2023-01-25T09:39:00.289 INFO:teuthology.orchestra.run.smithi138.stdout: osd max markdown count = 1000 2023-01-25T09:39:00.290 INFO:teuthology.orchestra.run.smithi138.stdout: osd max scrubs = 3 2023-01-25T09:39:00.290 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock override recovery settings = True 2023-01-25T09:39:00.290 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2023-01-25T09:39:00.290 INFO:teuthology.orchestra.run.smithi138.stdout: osd op queue = debug_random 2023-01-25T09:39:00.290 INFO:teuthology.orchestra.run.smithi138.stdout: osd op queue cut off = debug_random 2023-01-25T09:39:00.291 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub min interval = 60 2023-01-25T09:39:00.291 INFO:teuthology.orchestra.run.smithi138.stdout: osd shutdown pgref assert = True 2023-01-25T09:39:00.291 INFO:teuthology.orchestra.run.smithi138.stdout: osd_max_pg_log_entries = 3000 2023-01-25T09:39:00.291 INFO:teuthology.orchestra.run.smithi138.stdout: osd_min_pg_log_entries = 3000 2023-01-25T09:39:00.291 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.291 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2023-01-25T09:39:00.292 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-01-25T09:39:00.292 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2023-01-25T09:39:00.292 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2023-01-25T09:39:00.292 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2023-01-25T09:39:00.293 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2023-01-25T09:39:00.293 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2023-01-25T09:39:00.293 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2023-01-25T09:39:00.293 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.293 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2023-01-25T09:39:00.294 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-01-25T09:39:00.294 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2023-01-25T09:39:00.294 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2023-01-25T09:39:00.294 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2023-01-25T09:39:00.294 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2023-01-25T09:39:00.295 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2023-01-25T09:39:00.295 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2023-01-25T09:39:00.295 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2023-01-25T09:39:00.295 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2023-01-25T09:39:00.295 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2023-01-25T09:39:00.296 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.296 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T09:39:00.296 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T09:39:00.296 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T09:39:00.296 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.297 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T09:39:00.297 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T09:39:00.297 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T09:39:00.297 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.297 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2023-01-25T09:39:00.298 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2023-01-25T09:39:00.298 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.298 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2023-01-25T09:39:00.298 INFO:teuthology.orchestra.run.smithi138.stdout: mon scrub interval = 300 2023-01-25T09:39:00.298 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-01-25T09:39:00.299 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2023-01-25T09:39:00.299 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2023-01-25T09:39:00.299 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2023-01-25T09:39:00.299 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2023-01-25T09:39:00.299 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T09:39:00.300 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T09:39:00.300 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2023-01-25T09:39:00.300 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2023-01-25T09:39:00.300 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2023-01-25T09:39:00.301 INFO:tasks.ceph:Creating admin key on mon.a... 2023-01-25T09:39:00.301 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-01-25T09:39:00.365 INFO:tasks.ceph:Copying monmap to all nodes... 2023-01-25T09:39:00.366 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:00.366 DEBUG:teuthology.orchestra.run.smithi035:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-01-25T09:39:00.373 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:00.374 DEBUG:teuthology.orchestra.run.smithi035:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-01-25T09:39:00.423 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi035.front.sepia.ceph.com 2023-01-25T09:39:00.424 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:00.424 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T09:39:00.424 DEBUG:teuthology.orchestra.run.smithi035:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T09:39:00.450 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:00.451 DEBUG:teuthology.orchestra.run.smithi035:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:00.457 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2023-01-25T09:39:00.457 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:39:00.457 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T09:39:00.458 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T09:39:00.486 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:39:00.486 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:00.535 INFO:tasks.ceph:Setting up mon nodes... 2023-01-25T09:39:00.536 INFO:tasks.ceph:Setting up mgr nodes... 2023-01-25T09:39:00.536 DEBUG:teuthology.orchestra.run.smithi035:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T09:39:00.587 INFO:teuthology.orchestra.run.smithi035.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T09:39:00.590 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T09:39:00.641 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T09:39:00.655 INFO:tasks.ceph:Setting up mds nodes... 2023-01-25T09:39:00.655 INFO:tasks.ceph_client:Setting up client nodes... 2023-01-25T09:39:00.656 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-25T09:39:00.699 INFO:teuthology.orchestra.run.smithi035.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-01-25T09:39:00.713 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-01-25T09:39:00.756 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-01-25T09:39:00.769 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-01-25T09:39:00.770 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi035.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T09:39:00.770 DEBUG:teuthology.orchestra.run.smithi035:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-01-25T09:39:00.787 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:39:00.788 INFO:tasks.ceph:role: osd.0 2023-01-25T09:39:00.788 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi035.front.sepia.ceph.com 2023-01-25T09:39:00.788 DEBUG:teuthology.orchestra.run.smithi035:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T09:39:01.339 INFO:teuthology.orchestra.run.smithi035.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:39:01.340 INFO:teuthology.orchestra.run.smithi035.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:39:01.340 INFO:teuthology.orchestra.run.smithi035.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:39:01.340 INFO:teuthology.orchestra.run.smithi035.stdout: = reflink=1 2023-01-25T09:39:01.340 INFO:teuthology.orchestra.run.smithi035.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:39:01.341 INFO:teuthology.orchestra.run.smithi035.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:39:01.341 INFO:teuthology.orchestra.run.smithi035.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:39:01.341 INFO:teuthology.orchestra.run.smithi035.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:39:01.341 INFO:teuthology.orchestra.run.smithi035.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:39:01.341 INFO:teuthology.orchestra.run.smithi035.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:39:01.343 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi035.front.sepia.ceph.com -o noatime 2023-01-25T09:39:01.343 DEBUG:teuthology.orchestra.run.smithi035:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-01-25T09:39:01.392 DEBUG:teuthology.orchestra.run.smithi035:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-01-25T09:39:01.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:39:01.406 INFO:teuthology.orchestra.run.smithi035.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:39:01.407 DEBUG:teuthology.orchestra.run.smithi035:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-01-25T09:39:01.417 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:39:01.418 INFO:tasks.ceph:role: osd.1 2023-01-25T09:39:01.418 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi035.front.sepia.ceph.com 2023-01-25T09:39:01.419 DEBUG:teuthology.orchestra.run.smithi035:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T09:39:01.965 INFO:teuthology.orchestra.run.smithi035.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:39:01.966 INFO:teuthology.orchestra.run.smithi035.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:39:01.966 INFO:teuthology.orchestra.run.smithi035.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:39:01.966 INFO:teuthology.orchestra.run.smithi035.stdout: = reflink=1 2023-01-25T09:39:01.966 INFO:teuthology.orchestra.run.smithi035.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:39:01.967 INFO:teuthology.orchestra.run.smithi035.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:39:01.967 INFO:teuthology.orchestra.run.smithi035.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:39:01.967 INFO:teuthology.orchestra.run.smithi035.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:39:01.967 INFO:teuthology.orchestra.run.smithi035.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:39:01.967 INFO:teuthology.orchestra.run.smithi035.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:39:01.968 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi035.front.sepia.ceph.com -o noatime 2023-01-25T09:39:01.969 DEBUG:teuthology.orchestra.run.smithi035:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-01-25T09:39:02.060 DEBUG:teuthology.orchestra.run.smithi035:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-01-25T09:39:02.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:39:02.073 INFO:teuthology.orchestra.run.smithi035.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:39:02.073 DEBUG:teuthology.orchestra.run.smithi035:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-01-25T09:39:02.132 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:39:02.133 INFO:tasks.ceph:role: osd.2 2023-01-25T09:39:02.133 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi035.front.sepia.ceph.com 2023-01-25T09:39:02.134 DEBUG:teuthology.orchestra.run.smithi035:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T09:39:02.628 INFO:teuthology.orchestra.run.smithi035.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:39:02.629 INFO:teuthology.orchestra.run.smithi035.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:39:02.629 INFO:teuthology.orchestra.run.smithi035.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:39:02.629 INFO:teuthology.orchestra.run.smithi035.stdout: = reflink=1 2023-01-25T09:39:02.630 INFO:teuthology.orchestra.run.smithi035.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:39:02.630 INFO:teuthology.orchestra.run.smithi035.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:39:02.631 INFO:teuthology.orchestra.run.smithi035.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:39:02.631 INFO:teuthology.orchestra.run.smithi035.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:39:02.631 INFO:teuthology.orchestra.run.smithi035.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:39:02.632 INFO:teuthology.orchestra.run.smithi035.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:39:02.633 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi035.front.sepia.ceph.com -o noatime 2023-01-25T09:39:02.634 DEBUG:teuthology.orchestra.run.smithi035:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-01-25T09:39:02.675 DEBUG:teuthology.orchestra.run.smithi035:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-01-25T09:39:02.728 INFO:teuthology.orchestra.run.smithi035.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:39:02.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:39:02.729 DEBUG:teuthology.orchestra.run.smithi035:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-01-25T09:39:02.742 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:39:02.742 INFO:tasks.ceph:role: osd.3 2023-01-25T09:39:02.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi035.front.sepia.ceph.com 2023-01-25T09:39:02.743 DEBUG:teuthology.orchestra.run.smithi035:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T09:39:03.258 INFO:teuthology.orchestra.run.smithi035.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:39:03.259 INFO:teuthology.orchestra.run.smithi035.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:39:03.259 INFO:teuthology.orchestra.run.smithi035.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:39:03.259 INFO:teuthology.orchestra.run.smithi035.stdout: = reflink=1 2023-01-25T09:39:03.259 INFO:teuthology.orchestra.run.smithi035.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:39:03.260 INFO:teuthology.orchestra.run.smithi035.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:39:03.260 INFO:teuthology.orchestra.run.smithi035.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:39:03.260 INFO:teuthology.orchestra.run.smithi035.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:39:03.260 INFO:teuthology.orchestra.run.smithi035.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:39:03.260 INFO:teuthology.orchestra.run.smithi035.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:39:03.261 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi035.front.sepia.ceph.com -o noatime 2023-01-25T09:39:03.262 DEBUG:teuthology.orchestra.run.smithi035:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-01-25T09:39:03.316 DEBUG:teuthology.orchestra.run.smithi035:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-01-25T09:39:03.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:39:03.328 INFO:teuthology.orchestra.run.smithi035.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:39:03.328 DEBUG:teuthology.orchestra.run.smithi035:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:03.432 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:03.425+0000 7fb993f79640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-01-25T09:39:03.434 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:03.429+0000 7fb993f79640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-01-25T09:39:03.435 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:03.429+0000 7fb993f79640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T09:39:03.435 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:03.429+0000 7fb993f79640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T09:39:03.435 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:03.429+0000 7fb993f79640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T09:39:03.436 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:03.429+0000 7fb993f79640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-01-25T09:39:04.028 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:04.021+0000 7fb993f79640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:04.815 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:04.809+0000 7fb993f79640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:05.589 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:05.581+0000 7fb993f79640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:06.453 DEBUG:teuthology.orchestra.run.smithi035:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-25T09:39:06.468 DEBUG:teuthology.orchestra.run.smithi035:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:06.518 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:06.513+0000 7fcf08796640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-01-25T09:39:06.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:06.513+0000 7fcf08796640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-01-25T09:39:06.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:06.513+0000 7fcf08796640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T09:39:06.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:06.513+0000 7fcf08796640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T09:39:06.519 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:06.513+0000 7fcf08796640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T09:39:06.520 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:06.513+0000 7fcf08796640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-01-25T09:39:07.075 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:07.069+0000 7fcf08796640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:07.863 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:07.857+0000 7fcf08796640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:08.642 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:08.637+0000 7fcf08796640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:09.493 DEBUG:teuthology.orchestra.run.smithi035:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-25T09:39:09.510 DEBUG:teuthology.orchestra.run.smithi035:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:09.554 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:09.549+0000 7f14d9f81640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-01-25T09:39:09.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:09.549+0000 7f14d9f81640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-01-25T09:39:09.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:09.549+0000 7f14d9f81640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T09:39:09.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:09.549+0000 7f14d9f81640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T09:39:09.555 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:09.549+0000 7f14d9f81640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T09:39:09.556 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:09.549+0000 7f14d9f81640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-01-25T09:39:10.112 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:10.105+0000 7f14d9f81640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:10.906 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:10.901+0000 7f14d9f81640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:11.691 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:11.685+0000 7f14d9f81640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:12.551 DEBUG:teuthology.orchestra.run.smithi035:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-25T09:39:12.568 DEBUG:teuthology.orchestra.run.smithi035:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:12.609 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:12.601+0000 7f72fb4cb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-01-25T09:39:12.610 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:12.605+0000 7f72fb4cb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-01-25T09:39:12.610 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:12.605+0000 7f72fb4cb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T09:39:12.611 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:12.605+0000 7f72fb4cb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T09:39:12.611 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:12.605+0000 7f72fb4cb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T09:39:12.611 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:12.605+0000 7f72fb4cb640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-01-25T09:39:13.172 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:13.165+0000 7f72fb4cb640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:13.951 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:13.945+0000 7f72fb4cb640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:14.741 INFO:teuthology.orchestra.run.smithi035.stderr:2023-01-25T09:39:14.737+0000 7f72fb4cb640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:15.592 DEBUG:teuthology.orchestra.run.smithi035:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-25T09:39:15.649 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-01-25T09:39:15.666 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:39:15.667 INFO:tasks.ceph:role: osd.4 2023-01-25T09:39:15.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2023-01-25T09:39:15.667 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T09:39:16.178 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:39:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:39:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:39:16.178 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 2023-01-25T09:39:16.179 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:39:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:39:16.179 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:39:16.179 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:39:16.179 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:39:16.180 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:39:16.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2023-01-25T09:39:16.181 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-01-25T09:39:16.269 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-01-25T09:39:16.279 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:39:16.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:39:16.280 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-01-25T09:39:16.337 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:39:16.337 INFO:tasks.ceph:role: osd.5 2023-01-25T09:39:16.337 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2023-01-25T09:39:16.338 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T09:39:16.860 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:39:16.860 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:39:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:39:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 2023-01-25T09:39:16.861 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:39:16.861 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:39:16.861 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:39:16.862 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:39:16.862 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:39:16.862 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:39:16.863 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2023-01-25T09:39:16.863 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-01-25T09:39:16.896 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-01-25T09:39:16.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:39:16.906 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:39:16.907 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-01-25T09:39:16.964 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:39:16.965 INFO:tasks.ceph:role: osd.6 2023-01-25T09:39:16.965 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2023-01-25T09:39:16.965 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T09:39:17.418 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:39:17.418 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:39:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:39:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 2023-01-25T09:39:17.419 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:39:17.419 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:39:17.420 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:39:17.420 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:39:17.420 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:39:17.420 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:39:17.421 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2023-01-25T09:39:17.422 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-01-25T09:39:17.483 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-01-25T09:39:17.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:39:17.495 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:39:17.496 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-01-25T09:39:17.507 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:39:17.508 INFO:tasks.ceph:role: osd.7 2023-01-25T09:39:17.508 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com 2023-01-25T09:39:17.508 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T09:39:18.023 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:39:18.024 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:39:18.024 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:39:18.024 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 2023-01-25T09:39:18.024 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:39:18.025 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:39:18.025 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:39:18.025 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:39:18.025 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:39:18.025 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:39:18.026 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2023-01-25T09:39:18.027 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-01-25T09:39:18.083 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-01-25T09:39:18.094 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2023-01-25T09:39:18.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:39:18.095 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:18.226 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:18.220+0000 7f98c3766640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-01-25T09:39:18.229 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:18.220+0000 7f98c3766640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-01-25T09:39:18.230 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:18.220+0000 7f98c3766640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T09:39:18.230 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:18.220+0000 7f98c3766640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T09:39:18.230 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:18.224+0000 7f98c3766640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T09:39:18.234 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:18.228+0000 7f98c3766640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-01-25T09:39:19.041 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:19.032+0000 7f98c3766640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:19.818 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:19.811+0000 7f98c3766640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:20.605 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:20.595+0000 7f98c3766640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:21.473 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-25T09:39:21.489 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:21.535 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:21.527+0000 7fc5b9b4d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-01-25T09:39:21.535 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:21.527+0000 7fc5b9b4d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-01-25T09:39:21.535 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:21.527+0000 7fc5b9b4d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T09:39:21.536 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:21.527+0000 7fc5b9b4d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T09:39:21.536 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:21.527+0000 7fc5b9b4d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T09:39:21.536 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:21.527+0000 7fc5b9b4d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-01-25T09:39:22.092 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:22.083+0000 7fc5b9b4d640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:22.893 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:22.883+0000 7fc5b9b4d640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:23.663+0000 7fc5b9b4d640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:24.537 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-25T09:39:24.554 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:24.599 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:24.591+0000 7f1a46552640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-01-25T09:39:24.600 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:24.591+0000 7f1a46552640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-01-25T09:39:24.600 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:24.591+0000 7f1a46552640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T09:39:24.600 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:24.591+0000 7f1a46552640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T09:39:24.601 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:24.591+0000 7f1a46552640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T09:39:24.601 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:24.591+0000 7f1a46552640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-01-25T09:39:25.162 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:25.155+0000 7f1a46552640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:25.942 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:25.935+0000 7f1a46552640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:26.720 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:26.711+0000 7f1a46552640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:27.588 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-01-25T09:39:27.602 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:27.649 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:27.639+0000 7fb233433640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-01-25T09:39:27.649 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:27.639+0000 7fb233433640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-01-25T09:39:27.649 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:27.639+0000 7fb233433640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T09:39:27.650 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:27.639+0000 7fb233433640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T09:39:27.650 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:27.639+0000 7fb233433640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T09:39:27.650 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:27.643+0000 7fb233433640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-01-25T09:39:28.219 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:28.211+0000 7fb233433640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:28.997 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:28.987+0000 7fb233433640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:29.779 INFO:teuthology.orchestra.run.smithi138.stderr:2023-01-25T09:39:29.771+0000 7fb233433640 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:39:30.640 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-01-25T09:39:30.654 INFO:tasks.ceph:Reading keys from all nodes... 2023-01-25T09:39:30.655 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:30.655 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-01-25T09:39:30.672 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:30.672 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-01-25T09:39:30.684 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:30.684 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-01-25T09:39:30.739 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:30.739 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-01-25T09:39:30.753 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:30.754 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-01-25T09:39:30.768 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:39:30.769 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-01-25T09:39:30.785 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:39:30.785 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-01-25T09:39:30.839 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:39:30.840 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-01-25T09:39:30.856 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:39:30.856 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-01-25T09:39:30.865 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:39:30.865 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-01-25T09:39:30.925 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:30.925 DEBUG:teuthology.orchestra.run.smithi035:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-01-25T09:39:30.932 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:39:30.932 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-01-25T09:39:30.937 INFO:tasks.ceph:Adding keys to all mons... 2023-01-25T09:39:30.937 DEBUG:teuthology.orchestra.run.smithi035:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T09:39:30.974 DEBUG:teuthology.orchestra.run.smithi138:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T09:39:30.987 INFO:teuthology.orchestra.run.smithi035.stdout:[mgr.y] 2023-01-25T09:39:30.987 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQC0+NBjuYzKIhAAqWrG6Q8lBhJ53Ffi1PKPew== 2023-01-25T09:39:30.987 INFO:teuthology.orchestra.run.smithi035.stdout:[osd.0] 2023-01-25T09:39:30.988 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQC3+NBj0tWVGRAAXrXIRkZ03xZASifQvmXqaw== 2023-01-25T09:39:30.988 INFO:teuthology.orchestra.run.smithi035.stdout:[osd.1] 2023-01-25T09:39:30.988 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQC6+NBjMbCyHhAA3Qk2XUmYLxHAUOCtcBZlHA== 2023-01-25T09:39:30.988 INFO:teuthology.orchestra.run.smithi035.stdout:[osd.2] 2023-01-25T09:39:30.988 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQC9+NBjzJnYIBAAPO9VBkf6J7kjLv3SR0ht2g== 2023-01-25T09:39:30.989 INFO:teuthology.orchestra.run.smithi035.stdout:[osd.3] 2023-01-25T09:39:30.989 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQDA+NBjENUhJBAAN8yPQJMXJNOe/eKXYitVsA== 2023-01-25T09:39:30.989 INFO:teuthology.orchestra.run.smithi035.stdout:[mgr.x] 2023-01-25T09:39:30.989 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQC0+NBjN6oFJhAAsGHsK7l7BLUT2x8hPsp4EQ== 2023-01-25T09:39:30.989 INFO:teuthology.orchestra.run.smithi035.stdout:[osd.4] 2023-01-25T09:39:30.989 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQDG+NBj0A9MDRAATm/krxgCTKMD9OFPBvzT3w== 2023-01-25T09:39:30.990 INFO:teuthology.orchestra.run.smithi035.stdout:[osd.5] 2023-01-25T09:39:30.990 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQDJ+NBjFFCsHxAAjaLFhvFcmM4CfHd91LB6Jw== 2023-01-25T09:39:30.990 INFO:teuthology.orchestra.run.smithi035.stdout:[osd.6] 2023-01-25T09:39:30.990 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQDM+NBjb4R8IxAAc3DWS5MXCrIPk0ZyZO5viw== 2023-01-25T09:39:30.990 INFO:teuthology.orchestra.run.smithi035.stdout:[osd.7] 2023-01-25T09:39:30.991 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQDP+NBjDBx6JhAAkV5gWw2u+xhSicplpZNqhw== 2023-01-25T09:39:30.991 INFO:teuthology.orchestra.run.smithi035.stdout:[client.0] 2023-01-25T09:39:30.991 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQC0+NBjbAV+KRAAPgURmA1plzuVow+zWgz8kg== 2023-01-25T09:39:30.991 INFO:teuthology.orchestra.run.smithi035.stdout:[client.1] 2023-01-25T09:39:30.991 INFO:teuthology.orchestra.run.smithi035.stdout: key = AQC0+NBjsVbdLBAAHML/s8rApoppLvWjAr0Ebg== 2023-01-25T09:39:30.993 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.y] 2023-01-25T09:39:30.993 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQC0+NBjuYzKIhAAqWrG6Q8lBhJ53Ffi1PKPew== 2023-01-25T09:39:30.993 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2023-01-25T09:39:30.993 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQC3+NBj0tWVGRAAXrXIRkZ03xZASifQvmXqaw== 2023-01-25T09:39:30.994 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2023-01-25T09:39:30.994 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQC6+NBjMbCyHhAA3Qk2XUmYLxHAUOCtcBZlHA== 2023-01-25T09:39:30.994 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2023-01-25T09:39:30.994 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQC9+NBjzJnYIBAAPO9VBkf6J7kjLv3SR0ht2g== 2023-01-25T09:39:30.994 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.3] 2023-01-25T09:39:30.995 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDA+NBjENUhJBAAN8yPQJMXJNOe/eKXYitVsA== 2023-01-25T09:39:30.995 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.x] 2023-01-25T09:39:30.995 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQC0+NBjN6oFJhAAsGHsK7l7BLUT2x8hPsp4EQ== 2023-01-25T09:39:30.995 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.4] 2023-01-25T09:39:30.995 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDG+NBj0A9MDRAATm/krxgCTKMD9OFPBvzT3w== 2023-01-25T09:39:30.995 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.5] 2023-01-25T09:39:30.996 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDJ+NBjFFCsHxAAjaLFhvFcmM4CfHd91LB6Jw== 2023-01-25T09:39:30.996 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.6] 2023-01-25T09:39:30.996 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDM+NBjb4R8IxAAc3DWS5MXCrIPk0ZyZO5viw== 2023-01-25T09:39:30.996 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.7] 2023-01-25T09:39:30.996 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDP+NBjDBx6JhAAkV5gWw2u+xhSicplpZNqhw== 2023-01-25T09:39:30.997 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2023-01-25T09:39:30.997 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQC0+NBjbAV+KRAAPgURmA1plzuVow+zWgz8kg== 2023-01-25T09:39:30.997 INFO:teuthology.orchestra.run.smithi138.stdout:[client.1] 2023-01-25T09:39:30.997 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQC0+NBjsVbdLBAAHML/s8rApoppLvWjAr0Ebg== 2023-01-25T09:39:30.998 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T09:39:31.000 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T09:39:31.088 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.091 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.144 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.146 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.194 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.197 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.246 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.248 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.297 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T09:39:31.335 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T09:39:31.389 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.391 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.440 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.442 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.490 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.493 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.540 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.543 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:39:31.589 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T09:39:31.591 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T09:39:31.640 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T09:39:31.643 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T09:39:31.693 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-01-25T09:39:31.694 DEBUG:teuthology.orchestra.run.smithi035:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-01-25T09:39:31.708 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T09:39:31.816 DEBUG:teuthology.orchestra.run.smithi035:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-01-25T09:39:31.829 DEBUG:teuthology.orchestra.run.smithi035:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-01-25T09:39:31.840 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T09:39:31.949 DEBUG:teuthology.orchestra.run.smithi035:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-01-25T09:39:31.962 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-01-25T09:39:31.979 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T09:39:32.040 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-01-25T09:39:32.052 DEBUG:teuthology.orchestra.run.smithi035:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:32.054 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:39:32.099 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-01-25T09:39:32.099 INFO:tasks.ceph.mon.a:Restarting daemon 2023-01-25T09:39:32.100 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-01-25T09:39:32.102 INFO:tasks.ceph.mon.a:Started 2023-01-25T09:39:32.103 INFO:tasks.ceph.mon.c:Restarting daemon 2023-01-25T09:39:32.103 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-01-25T09:39:32.105 INFO:tasks.ceph.mon.c:Started 2023-01-25T09:39:32.106 INFO:tasks.ceph.mon.b:Restarting daemon 2023-01-25T09:39:32.106 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-01-25T09:39:32.108 INFO:tasks.ceph.mon.b:Started 2023-01-25T09:39:32.108 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-01-25T09:39:32.109 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-01-25T09:39:32.109 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-01-25T09:39:32.112 INFO:tasks.ceph.mgr.y:Started 2023-01-25T09:39:32.112 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-01-25T09:39:32.112 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-01-25T09:39:32.115 INFO:tasks.ceph.mgr.x:Started 2023-01-25T09:39:32.115 INFO:tasks.ceph:Setting crush tunables to default 2023-01-25T09:39:32.115 DEBUG:teuthology.orchestra.run.smithi035:> sudo ceph --cluster ceph osd crush tunables default 2023-01-25T09:39:38.834 INFO:teuthology.orchestra.run.smithi035.stderr:adjusted tunables profile to default 2023-01-25T09:39:38.846 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-01-25T09:39:38.847 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:38.847 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-01-25T09:39:38.857 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:38.858 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-01-25T09:39:38.868 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:38.869 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-01-25T09:39:38.879 DEBUG:teuthology.orchestra.run.smithi035:> set -ex 2023-01-25T09:39:38.879 DEBUG:teuthology.orchestra.run.smithi035:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-01-25T09:39:38.886 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:38.879+0000 7f13375332c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T09:39:38.887 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:38.880+0000 7f22bedc82c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T09:39:38.889 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:39:38.890 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-01-25T09:39:38.906 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:39:38.906 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-01-25T09:39:38.964 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:39:38.964 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-01-25T09:39:38.973 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-01-25T09:39:38.973 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-01-25T09:39:38.983 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 1dc18a6c-8ced-4d84-a47f-65ef5b240951 0 2023-01-25T09:39:39.189 INFO:teuthology.orchestra.run.smithi138.stdout:0 2023-01-25T09:39:39.206 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new d7f82dcf-6f57-4086-8cf2-417cbe173dd1 1 2023-01-25T09:39:39.412 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-01-25T09:39:39.427 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new f574de08-f0ef-436d-bf0f-8521c01a20d0 2 2023-01-25T09:39:39.517 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:39.508+0000 7f22bedc82c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T09:39:39.536 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:39.527+0000 7f13375332c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T09:39:39.576 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:39.568+0000 7f22bedc82c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T09:39:39.594 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:39.587+0000 7f13375332c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T09:39:39.627 INFO:teuthology.orchestra.run.smithi138.stdout:2 2023-01-25T09:39:39.641 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new e704cff4-131e-4001-9997-fe3a18f603a9 3 2023-01-25T09:39:39.695 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:39.688+0000 7f22bedc82c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T09:39:39.712 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:39.703+0000 7f13375332c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T09:39:39.849 INFO:teuthology.orchestra.run.smithi138.stdout:3 2023-01-25T09:39:39.863 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new cdd53f9e-272e-4395-943f-a2d67a590060 4 2023-01-25T09:39:39.942 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:39.936+0000 7f22bedc82c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T09:39:39.950 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:39.943+0000 7f13375332c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T09:39:39.996 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:39.988+0000 7f22bedc82c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T09:39:40.002 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:39.995+0000 7f13375332c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T09:39:40.059 INFO:teuthology.orchestra.run.smithi138.stdout:4 2023-01-25T09:39:40.074 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 4cca5da7-47ab-4f4f-bbb9-1a9927162000 5 2023-01-25T09:39:40.183 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:40.176+0000 7f22bedc82c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T09:39:40.208 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:40.199+0000 7f13375332c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T09:39:40.252 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:40.244+0000 7f22bedc82c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T09:39:40.269 INFO:teuthology.orchestra.run.smithi138.stdout:5 2023-01-25T09:39:40.273 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:40.263+0000 7f13375332c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T09:39:40.282 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new fb4766e6-92ef-46c6-b052-99a7e95157f3 6 2023-01-25T09:39:40.320 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:40.312+0000 7f22bedc82c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T09:39:40.336 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:40.327+0000 7f13375332c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T09:39:40.478 INFO:teuthology.orchestra.run.smithi138.stdout:6 2023-01-25T09:39:40.490 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new f0f7974b-e2de-43a8-a643-2d3b697c3d74 7 2023-01-25T09:39:40.697 INFO:teuthology.orchestra.run.smithi138.stdout:7 2023-01-25T09:39:40.714 INFO:tasks.ceph.osd.0:Restarting daemon 2023-01-25T09:39:40.714 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-01-25T09:39:40.717 INFO:tasks.ceph.osd.0:Started 2023-01-25T09:39:40.717 INFO:tasks.ceph.osd.1:Restarting daemon 2023-01-25T09:39:40.717 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-01-25T09:39:40.719 INFO:tasks.ceph.osd.1:Started 2023-01-25T09:39:40.720 INFO:tasks.ceph.osd.2:Restarting daemon 2023-01-25T09:39:40.720 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-01-25T09:39:40.722 INFO:tasks.ceph.osd.2:Started 2023-01-25T09:39:40.723 INFO:tasks.ceph.osd.3:Restarting daemon 2023-01-25T09:39:40.723 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-01-25T09:39:40.725 INFO:tasks.ceph.osd.3:Started 2023-01-25T09:39:40.726 INFO:tasks.ceph.osd.4:Restarting daemon 2023-01-25T09:39:40.726 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-01-25T09:39:40.728 INFO:tasks.ceph.osd.4:Started 2023-01-25T09:39:40.729 INFO:tasks.ceph.osd.5:Restarting daemon 2023-01-25T09:39:40.729 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-01-25T09:39:40.730 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:40.724+0000 7f22bedc82c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T09:39:40.731 INFO:tasks.ceph.osd.5:Started 2023-01-25T09:39:40.732 INFO:tasks.ceph.osd.6:Restarting daemon 2023-01-25T09:39:40.732 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-01-25T09:39:40.734 INFO:tasks.ceph.osd.6:Started 2023-01-25T09:39:40.735 INFO:tasks.ceph.osd.7:Restarting daemon 2023-01-25T09:39:40.735 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-01-25T09:39:40.737 INFO:tasks.ceph.osd.7:Started 2023-01-25T09:39:40.738 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T09:39:40.778 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:40.771+0000 7f13375332c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T09:39:40.888 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:40.880+0000 7f22bedc82c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T09:39:40.913 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:40.903+0000 7f13375332c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T09:39:40.938 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:40.938 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":10,"fsid":"97131e4b-ba28-4ab8-a3d7-d027cd4303dd","created":"2023-01-25T09:39:38.460356+0000","modified":"2023-01-25T09:39:40.687391+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T09:39:40.687391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"1dc18a6c-8ced-4d84-a47f-65ef5b240951","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d7f82dcf-6f57-4086-8cf2-417cbe173dd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f574de08-f0ef-436d-bf0f-8521c01a20d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e704cff4-131e-4001-9997-fe3a18f603a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cdd53f9e-272e-4395-943f-a2d67a590060","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4cca5da7-47ab-4f4f-bbb9-1a9927162000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fb4766e6-92ef-46c6-b052-99a7e95157f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f0f7974b-e2de-43a8-a643-2d3b697c3d74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:39:40.950 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-01-25T09:39:40.951 INFO:tasks.ceph:Waiting for OSDs to come up 2023-01-25T09:39:41.091 INFO:tasks.ceph.osd.0.smithi035.stderr:2023-01-25T09:39:41.084+0000 7f12780a7640 -1 Falling back to public interface 2023-01-25T09:39:41.092 INFO:tasks.ceph.osd.2.smithi035.stderr:2023-01-25T09:39:41.084+0000 7f794fad8640 -1 Falling back to public interface 2023-01-25T09:39:41.111 INFO:tasks.ceph.osd.4.smithi138.stderr:2023-01-25T09:39:41.103+0000 7fb119921640 -1 Falling back to public interface 2023-01-25T09:39:41.217 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:41.208+0000 7f22bedc82c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T09:39:41.225 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:41.215+0000 7f13375332c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T09:39:41.371 INFO:tasks.ceph.osd.5.smithi138.stderr:2023-01-25T09:39:41.363+0000 7f7b9caca640 -1 Falling back to public interface 2023-01-25T09:39:41.372 INFO:tasks.ceph.osd.1.smithi035.stderr:2023-01-25T09:39:41.364+0000 7f2958603640 -1 Falling back to public interface 2023-01-25T09:39:41.379 INFO:tasks.ceph.osd.3.smithi035.stderr:2023-01-25T09:39:41.372+0000 7f41f5b8b640 -1 Falling back to public interface 2023-01-25T09:39:41.386 INFO:tasks.ceph.osd.6.smithi138.stderr:2023-01-25T09:39:41.379+0000 7fc0906f9640 -1 Falling back to public interface 2023-01-25T09:39:41.388 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:41.379+0000 7f13375332c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T09:39:41.390 INFO:tasks.ceph.osd.7.smithi138.stderr:2023-01-25T09:39:41.383+0000 7f4f6caf8640 -1 Falling back to public interface 2023-01-25T09:39:41.394 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:41.388+0000 7f22bedc82c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T09:39:41.459 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:41.451+0000 7f13375332c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T09:39:41.463 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:41.456+0000 7f22bedc82c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T09:39:41.512 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:41.503+0000 7f13375332c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T09:39:41.518 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:41.512+0000 7f22bedc82c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T09:39:41.756 DEBUG:teuthology.orchestra.run.smithi035:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T09:39:41.943 INFO:teuthology.misc.health.smithi035.stdout: 2023-01-25T09:39:41.943 INFO:teuthology.misc.health.smithi035.stdout:{"epoch":10,"fsid":"97131e4b-ba28-4ab8-a3d7-d027cd4303dd","created":"2023-01-25T09:39:38.460356+0000","modified":"2023-01-25T09:39:40.687391+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T09:39:40.687391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"1dc18a6c-8ced-4d84-a47f-65ef5b240951","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d7f82dcf-6f57-4086-8cf2-417cbe173dd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f574de08-f0ef-436d-bf0f-8521c01a20d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e704cff4-131e-4001-9997-fe3a18f603a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cdd53f9e-272e-4395-943f-a2d67a590060","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4cca5da7-47ab-4f4f-bbb9-1a9927162000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fb4766e6-92ef-46c6-b052-99a7e95157f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f0f7974b-e2de-43a8-a643-2d3b697c3d74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:39:41.954 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-01-25T09:39:42.319 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:42.312+0000 7f22bedc82c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T09:39:42.344 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:42.335+0000 7f13375332c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T09:39:42.384 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:42.376+0000 7f22bedc82c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T09:39:42.404 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:42.395+0000 7f13375332c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T09:39:42.553 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:42.544+0000 7f22bedc82c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T09:39:42.579 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:42.571+0000 7f13375332c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T09:39:42.619 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:42.612+0000 7f22bedc82c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T09:39:42.642 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:42.635+0000 7f13375332c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T09:39:42.689 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:42.680+0000 7f22bedc82c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T09:39:42.713 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:42.703+0000 7f13375332c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T09:39:42.869 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:42.860+0000 7f22bedc82c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T09:39:42.886 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:42.879+0000 7f13375332c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T09:39:42.942 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:42.936+0000 7f22bedc82c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T09:39:42.958 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:42.951+0000 7f13375332c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T09:39:43.757 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:43.748+0000 7f22bedc82c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T09:39:43.763 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-01-25T09:39:43.755+0000 7f13375332c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T09:39:44.706 INFO:tasks.ceph.osd.2.smithi035.stderr:2023-01-25T09:39:44.700+0000 7f794fad8640 -1 osd.2 0 log_to_monitors true 2023-01-25T09:39:44.802 INFO:tasks.ceph.mgr.y.smithi035.stderr:2023-01-25T09:39:44.796+0000 7f22a635d700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-01-25T09:39:44.983 INFO:tasks.ceph.osd.0.smithi035.stderr:2023-01-25T09:39:44.976+0000 7f12780a7640 -1 osd.0 0 log_to_monitors true 2023-01-25T09:39:45.001 INFO:tasks.ceph.osd.1.smithi035.stderr:2023-01-25T09:39:44.992+0000 7f2958603640 -1 osd.1 0 log_to_monitors true 2023-01-25T09:39:45.022 INFO:tasks.ceph.osd.4.smithi138.stderr:2023-01-25T09:39:45.015+0000 7fb119921640 -1 osd.4 0 log_to_monitors true 2023-01-25T09:39:45.034 INFO:tasks.ceph.osd.6.smithi138.stderr:2023-01-25T09:39:45.027+0000 7fc0906f9640 -1 osd.6 0 log_to_monitors true 2023-01-25T09:39:45.035 INFO:tasks.ceph.osd.7.smithi138.stderr:2023-01-25T09:39:45.027+0000 7f4f6caf8640 -1 osd.7 0 log_to_monitors true 2023-01-25T09:39:45.182 INFO:tasks.ceph.osd.3.smithi035.stderr:2023-01-25T09:39:45.176+0000 7f41f5b8b640 -1 osd.3 0 log_to_monitors true 2023-01-25T09:39:45.195 INFO:tasks.ceph.osd.5.smithi138.stderr:2023-01-25T09:39:45.187+0000 7f7b9caca640 -1 osd.5 0 log_to_monitors true 2023-01-25T09:39:45.866 INFO:tasks.ceph.osd.2.smithi035.stderr:2023-01-25T09:39:45.860+0000 7f794ca9d700 -1 osd.2 0 waiting for initial osdmap 2023-01-25T09:39:45.878 INFO:tasks.ceph.osd.2.smithi035.stderr:2023-01-25T09:39:45.872+0000 7f79473cf700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:39:46.869 INFO:tasks.ceph.osd.1.smithi035.stderr:2023-01-25T09:39:46.860+0000 7f2953c1d700 -1 osd.1 0 waiting for initial osdmap 2023-01-25T09:39:46.869 INFO:tasks.ceph.osd.4.smithi138.stderr:2023-01-25T09:39:46.859+0000 7fb114f3b700 -1 osd.4 0 waiting for initial osdmap 2023-01-25T09:39:46.871 INFO:tasks.ceph.osd.0.smithi035.stderr:2023-01-25T09:39:46.864+0000 7f12736c1700 -1 osd.0 0 waiting for initial osdmap 2023-01-25T09:39:46.877 INFO:tasks.ceph.osd.6.smithi138.stderr:2023-01-25T09:39:46.867+0000 7fc08bd13700 -1 osd.6 0 waiting for initial osdmap 2023-01-25T09:39:46.877 INFO:tasks.ceph.osd.7.smithi138.stderr:2023-01-25T09:39:46.867+0000 7f4f69abd700 -1 osd.7 0 waiting for initial osdmap 2023-01-25T09:39:46.878 INFO:tasks.ceph.osd.5.smithi138.stderr:2023-01-25T09:39:46.867+0000 7f7b980e4700 -1 osd.5 0 waiting for initial osdmap 2023-01-25T09:39:46.878 INFO:tasks.ceph.osd.4.smithi138.stderr:2023-01-25T09:39:46.871+0000 7fb111218700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:39:46.879 INFO:tasks.ceph.osd.3.smithi035.stderr:2023-01-25T09:39:46.868+0000 7f41f2b50700 -1 osd.3 0 waiting for initial osdmap 2023-01-25T09:39:46.879 INFO:tasks.ceph.osd.0.smithi035.stderr:2023-01-25T09:39:46.872+0000 7f126f99e700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:39:46.879 INFO:tasks.ceph.osd.1.smithi035.stderr:2023-01-25T09:39:46.872+0000 7f294fefa700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:39:46.882 INFO:tasks.ceph.osd.3.smithi035.stderr:2023-01-25T09:39:46.876+0000 7f41ecc81700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:39:46.884 INFO:tasks.ceph.osd.5.smithi138.stderr:2023-01-25T09:39:46.875+0000 7f7b93bc0700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:39:46.884 INFO:tasks.ceph.osd.6.smithi138.stderr:2023-01-25T09:39:46.875+0000 7fc087ff0700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:39:46.885 INFO:tasks.ceph.osd.7.smithi138.stderr:2023-01-25T09:39:46.875+0000 7f4f643ef700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:39:48.761 DEBUG:teuthology.orchestra.run.smithi035:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T09:39:49.060 INFO:teuthology.misc.health.smithi035.stdout: 2023-01-25T09:39:49.060 INFO:teuthology.misc.health.smithi035.stdout:{"epoch":15,"fsid":"97131e4b-ba28-4ab8-a3d7-d027cd4303dd","created":"2023-01-25T09:39:38.460356+0000","modified":"2023-01-25T09:39:48.877272+0000","last_up_change":"2023-01-25T09:39:47.874692+0000","last_in_change":"2023-01-25T09:39:40.687391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"1dc18a6c-8ced-4d84-a47f-65ef5b240951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6800","nonce":27884}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6801","nonce":27884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6803","nonce":27884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6802","nonce":27884}]},"public_addr":"172.21.15.35:6800/27884","cluster_addr":"172.21.15.35:6801/27884","heartbeat_back_addr":"172.21.15.35:6803/27884","heartbeat_front_addr":"172.21.15.35:6802/27884","state":["exists","up"]},{"osd":1,"uuid":"d7f82dcf-6f57-4086-8cf2-417cbe173dd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6808","nonce":27885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6809","nonce":27885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6811","nonce":27885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6810","nonce":27885}]},"public_addr":"172.21.15.35:6808/27885","cluster_addr":"172.21.15.35:6809/27885","heartbeat_back_addr":"172.21.15.35:6811/27885","heartbeat_front_addr":"172.21.15.35:6810/27885","state":["exists","up"]},{"osd":2,"uuid":"f574de08-f0ef-436d-bf0f-8521c01a20d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6804","nonce":27887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6805","nonce":27887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6807","nonce":27887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6806","nonce":27887}]},"public_addr":"172.21.15.35:6804/27887","cluster_addr":"172.21.15.35:6805/27887","heartbeat_back_addr":"172.21.15.35:6807/27887","heartbeat_front_addr":"172.21.15.35:6806/27887","state":["exists","up"]},{"osd":3,"uuid":"e704cff4-131e-4001-9997-fe3a18f603a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6812","nonce":27886}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6813","nonce":27886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6815","nonce":27886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6814","nonce":27886}]},"public_addr":"172.21.15.35:6812/27886","cluster_addr":"172.21.15.35:6813/27886","heartbeat_back_addr":"172.21.15.35:6815/27886","heartbeat_front_addr":"172.21.15.35:6814/27886","state":["exists","up"]},{"osd":4,"uuid":"cdd53f9e-272e-4395-943f-a2d67a590060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6800","nonce":28064}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6801","nonce":28064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6803","nonce":28064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6802","nonce":28064}]},"public_addr":"172.21.15.138:6800/28064","cluster_addr":"172.21.15.138:6801/28064","heartbeat_back_addr":"172.21.15.138:6803/28064","heartbeat_front_addr":"172.21.15.138:6802/28064","state":["exists","up"]},{"osd":5,"uuid":"4cca5da7-47ab-4f4f-bbb9-1a9927162000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6804","nonce":28066}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6805","nonce":28066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6807","nonce":28066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6806","nonce":28066}]},"public_addr":"172.21.15.138:6804/28066","cluster_addr":"172.21.15.138:6805/28066","heartbeat_back_addr":"172.21.15.138:6807/28066","heartbeat_front_addr":"172.21.15.138:6806/28066","state":["exists","up"]},{"osd":6,"uuid":"fb4766e6-92ef-46c6-b052-99a7e95157f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6808","nonce":28065}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6809","nonce":28065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6811","nonce":28065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6810","nonce":28065}]},"public_addr":"172.21.15.138:6808/28065","cluster_addr":"172.21.15.138:6809/28065","heartbeat_back_addr":"172.21.15.138:6811/28065","heartbeat_front_addr":"172.21.15.138:6810/28065","state":["exists","up"]},{"osd":7,"uuid":"f0f7974b-e2de-43a8-a643-2d3b697c3d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6812","nonce":28067}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6813","nonce":28067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6815","nonce":28067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6814","nonce":28067}]},"public_addr":"172.21.15.138:6812/28067","cluster_addr":"172.21.15.138:6813/28067","heartbeat_back_addr":"172.21.15.138:6815/28067","heartbeat_front_addr":"172.21.15.138:6814/28067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:45.939838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:45.991839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:45.663658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.183493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.054689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.216464+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.054720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.018094+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:39:49.073 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-01-25T09:39:49.074 INFO:tasks.ceph:Creating RBD pool 2023-01-25T09:39:49.074 DEBUG:teuthology.orchestra.run.smithi035:> sudo ceph --cluster ceph osd pool create rbd 8 2023-01-25T09:39:49.907 INFO:teuthology.orchestra.run.smithi035.stderr:pool 'rbd' created 2023-01-25T09:39:49.919 DEBUG:teuthology.orchestra.run.smithi035:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-01-25T09:39:50.916 INFO:teuthology.orchestra.run.smithi035.stderr:enabled application 'rbd' on pool 'rbd' 2023-01-25T09:39:50.929 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-01-25T09:39:50.929 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-25T09:39:50.929 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-01-25T09:39:50.930 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-01-25T09:39:50.930 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-01-25T09:39:51.280 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:51.293 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":4,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6816","nonce":27721}]},"active_addr":"172.21.15.35:6816/27721","active_change":"2023-01-25T09:39:43.771755+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.35:0","nonce":3358203585}]},{"addrvec":[{"type":"v2","addr":"172.21.15.35:0","nonce":923949232}]},{"addrvec":[{"type":"v2","addr":"172.21.15.35:0","nonce":3903123114}]}]}} 2023-01-25T09:39:51.297 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-01-25T09:39:51.298 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-01-25T09:39:51.298 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T09:39:51.584 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:51.585 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":17,"fsid":"97131e4b-ba28-4ab8-a3d7-d027cd4303dd","created":"2023-01-25T09:39:38.460356+0000","modified":"2023-01-25T09:39:50.891419+0000","last_up_change":"2023-01-25T09:39:47.874692+0000","last_in_change":"2023-01-25T09:39:40.687391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-25T09:39:49.404981+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-25T09:39:49.846729+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1dc18a6c-8ced-4d84-a47f-65ef5b240951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6800","nonce":27884}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6801","nonce":27884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6803","nonce":27884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6802","nonce":27884}]},"public_addr":"172.21.15.35:6800/27884","cluster_addr":"172.21.15.35:6801/27884","heartbeat_back_addr":"172.21.15.35:6803/27884","heartbeat_front_addr":"172.21.15.35:6802/27884","state":["exists","up"]},{"osd":1,"uuid":"d7f82dcf-6f57-4086-8cf2-417cbe173dd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6808","nonce":27885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6809","nonce":27885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6811","nonce":27885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6810","nonce":27885}]},"public_addr":"172.21.15.35:6808/27885","cluster_addr":"172.21.15.35:6809/27885","heartbeat_back_addr":"172.21.15.35:6811/27885","heartbeat_front_addr":"172.21.15.35:6810/27885","state":["exists","up"]},{"osd":2,"uuid":"f574de08-f0ef-436d-bf0f-8521c01a20d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6804","nonce":27887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6805","nonce":27887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6807","nonce":27887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6806","nonce":27887}]},"public_addr":"172.21.15.35:6804/27887","cluster_addr":"172.21.15.35:6805/27887","heartbeat_back_addr":"172.21.15.35:6807/27887","heartbeat_front_addr":"172.21.15.35:6806/27887","state":["exists","up"]},{"osd":3,"uuid":"e704cff4-131e-4001-9997-fe3a18f603a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6812","nonce":27886}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6813","nonce":27886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6815","nonce":27886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6814","nonce":27886}]},"public_addr":"172.21.15.35:6812/27886","cluster_addr":"172.21.15.35:6813/27886","heartbeat_back_addr":"172.21.15.35:6815/27886","heartbeat_front_addr":"172.21.15.35:6814/27886","state":["exists","up"]},{"osd":4,"uuid":"cdd53f9e-272e-4395-943f-a2d67a590060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6800","nonce":28064}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6801","nonce":28064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6803","nonce":28064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6802","nonce":28064}]},"public_addr":"172.21.15.138:6800/28064","cluster_addr":"172.21.15.138:6801/28064","heartbeat_back_addr":"172.21.15.138:6803/28064","heartbeat_front_addr":"172.21.15.138:6802/28064","state":["exists","up"]},{"osd":5,"uuid":"4cca5da7-47ab-4f4f-bbb9-1a9927162000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6804","nonce":28066}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6805","nonce":28066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6807","nonce":28066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6806","nonce":28066}]},"public_addr":"172.21.15.138:6804/28066","cluster_addr":"172.21.15.138:6805/28066","heartbeat_back_addr":"172.21.15.138:6807/28066","heartbeat_front_addr":"172.21.15.138:6806/28066","state":["exists","up"]},{"osd":6,"uuid":"fb4766e6-92ef-46c6-b052-99a7e95157f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6808","nonce":28065}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6809","nonce":28065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6811","nonce":28065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6810","nonce":28065}]},"public_addr":"172.21.15.138:6808/28065","cluster_addr":"172.21.15.138:6809/28065","heartbeat_back_addr":"172.21.15.138:6811/28065","heartbeat_front_addr":"172.21.15.138:6810/28065","state":["exists","up"]},{"osd":7,"uuid":"f0f7974b-e2de-43a8-a643-2d3b697c3d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6812","nonce":28067}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6813","nonce":28067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6815","nonce":28067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6814","nonce":28067}]},"public_addr":"172.21.15.138:6812/28067","cluster_addr":"172.21.15.138:6813/28067","heartbeat_back_addr":"172.21.15.138:6815/28067","heartbeat_front_addr":"172.21.15.138:6814/28067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:45.939838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:45.991839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:45.663658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.183493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.054689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.216464+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.054720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.018094+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:39:51.599 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-01-25T09:39:51.600 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T09:39:51.910 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:51.910 INFO:teuthology.orchestra.run.smithi035.stdout:{"epoch":17,"fsid":"97131e4b-ba28-4ab8-a3d7-d027cd4303dd","created":"2023-01-25T09:39:38.460356+0000","modified":"2023-01-25T09:39:50.891419+0000","last_up_change":"2023-01-25T09:39:47.874692+0000","last_in_change":"2023-01-25T09:39:40.687391+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-25T09:39:49.404981+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-25T09:39:49.846729+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"1dc18a6c-8ced-4d84-a47f-65ef5b240951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6800","nonce":27884}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6801","nonce":27884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6803","nonce":27884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6802","nonce":27884}]},"public_addr":"172.21.15.35:6800/27884","cluster_addr":"172.21.15.35:6801/27884","heartbeat_back_addr":"172.21.15.35:6803/27884","heartbeat_front_addr":"172.21.15.35:6802/27884","state":["exists","up"]},{"osd":1,"uuid":"d7f82dcf-6f57-4086-8cf2-417cbe173dd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6808","nonce":27885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6809","nonce":27885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6811","nonce":27885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6810","nonce":27885}]},"public_addr":"172.21.15.35:6808/27885","cluster_addr":"172.21.15.35:6809/27885","heartbeat_back_addr":"172.21.15.35:6811/27885","heartbeat_front_addr":"172.21.15.35:6810/27885","state":["exists","up"]},{"osd":2,"uuid":"f574de08-f0ef-436d-bf0f-8521c01a20d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6804","nonce":27887}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6805","nonce":27887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6807","nonce":27887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6806","nonce":27887}]},"public_addr":"172.21.15.35:6804/27887","cluster_addr":"172.21.15.35:6805/27887","heartbeat_back_addr":"172.21.15.35:6807/27887","heartbeat_front_addr":"172.21.15.35:6806/27887","state":["exists","up"]},{"osd":3,"uuid":"e704cff4-131e-4001-9997-fe3a18f603a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6812","nonce":27886}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6813","nonce":27886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6815","nonce":27886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.35:6814","nonce":27886}]},"public_addr":"172.21.15.35:6812/27886","cluster_addr":"172.21.15.35:6813/27886","heartbeat_back_addr":"172.21.15.35:6815/27886","heartbeat_front_addr":"172.21.15.35:6814/27886","state":["exists","up"]},{"osd":4,"uuid":"cdd53f9e-272e-4395-943f-a2d67a590060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6800","nonce":28064}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6801","nonce":28064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6803","nonce":28064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6802","nonce":28064}]},"public_addr":"172.21.15.138:6800/28064","cluster_addr":"172.21.15.138:6801/28064","heartbeat_back_addr":"172.21.15.138:6803/28064","heartbeat_front_addr":"172.21.15.138:6802/28064","state":["exists","up"]},{"osd":5,"uuid":"4cca5da7-47ab-4f4f-bbb9-1a9927162000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6804","nonce":28066}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6805","nonce":28066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6807","nonce":28066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6806","nonce":28066}]},"public_addr":"172.21.15.138:6804/28066","cluster_addr":"172.21.15.138:6805/28066","heartbeat_back_addr":"172.21.15.138:6807/28066","heartbeat_front_addr":"172.21.15.138:6806/28066","state":["exists","up"]},{"osd":6,"uuid":"fb4766e6-92ef-46c6-b052-99a7e95157f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6808","nonce":28065}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6809","nonce":28065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6811","nonce":28065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6810","nonce":28065}]},"public_addr":"172.21.15.138:6808/28065","cluster_addr":"172.21.15.138:6809/28065","heartbeat_back_addr":"172.21.15.138:6811/28065","heartbeat_front_addr":"172.21.15.138:6810/28065","state":["exists","up"]},{"osd":7,"uuid":"f0f7974b-e2de-43a8-a643-2d3b697c3d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6812","nonce":28067}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6813","nonce":28067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6815","nonce":28067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6814","nonce":28067}]},"public_addr":"172.21.15.138:6812/28067","cluster_addr":"172.21.15.138:6813/28067","heartbeat_back_addr":"172.21.15.138:6815/28067","heartbeat_front_addr":"172.21.15.138:6814/28067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:45.939838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:45.991839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:45.663658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.183493+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.054689+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.216464+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.054720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:39:46.018094+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:39:51.925 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-01-25T09:39:51.926 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-01-25T09:39:51.926 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-01-25T09:39:51.927 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-01-25T09:39:51.927 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-01-25T09:39:51.928 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-01-25T09:39:51.929 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-01-25T09:39:51.929 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-01-25T09:39:52.146 INFO:teuthology.orchestra.run.smithi035.stdout:60129542146 2023-01-25T09:39:52.146 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T09:39:52.148 INFO:teuthology.orchestra.run.smithi035.stdout:60129542147 2023-01-25T09:39:52.148 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T09:39:52.149 INFO:teuthology.orchestra.run.smithi035.stdout:55834574852 2023-01-25T09:39:52.150 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T09:39:52.152 INFO:teuthology.orchestra.run.smithi035.stdout:60129542147 2023-01-25T09:39:52.153 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T09:39:52.154 INFO:teuthology.orchestra.run.smithi035.stdout:60129542147 2023-01-25T09:39:52.154 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T09:39:52.160 INFO:teuthology.orchestra.run.smithi035.stdout:60129542146 2023-01-25T09:39:52.161 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T09:39:52.164 INFO:teuthology.orchestra.run.smithi035.stdout:60129542147 2023-01-25T09:39:52.164 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T09:39:52.213 INFO:teuthology.orchestra.run.smithi035.stdout:60129542146 2023-01-25T09:39:52.213 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T09:39:52.658 INFO:teuthology.orchestra.run.smithi035.stdout:60129542145 2023-01-25T09:39:52.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542145 for osd.5 2023-01-25T09:39:52.679 INFO:teuthology.orchestra.run.smithi035.stdout:60129542146 2023-01-25T09:39:52.680 INFO:teuthology.orchestra.run.smithi035.stdout:55834574850 2023-01-25T09:39:52.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.3 2023-01-25T09:39:52.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.2 2023-01-25T09:39:52.703 INFO:teuthology.orchestra.run.smithi035.stdout:60129542146 2023-01-25T09:39:52.708 INFO:teuthology.orchestra.run.smithi035.stdout:60129542146 2023-01-25T09:39:52.711 INFO:teuthology.orchestra.run.smithi035.stdout:60129542145 2023-01-25T09:39:52.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.6 2023-01-25T09:39:52.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.0 2023-01-25T09:39:52.724 INFO:teuthology.orchestra.run.smithi035.stdout:60129542146 2023-01-25T09:39:52.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542145 for osd.4 2023-01-25T09:39:52.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.1 2023-01-25T09:39:52.749 INFO:teuthology.orchestra.run.smithi035.stdout:60129542145 2023-01-25T09:39:52.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542145 for osd.7 2023-01-25T09:39:53.677 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T09:39:53.703 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T09:39:53.703 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T09:39:53.721 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T09:39:53.724 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T09:39:53.731 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T09:39:53.736 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T09:39:53.762 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T09:39:54.144 INFO:teuthology.orchestra.run.smithi035.stdout:60129542146 2023-01-25T09:39:54.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542146 for osd.5 2023-01-25T09:39:54.161 DEBUG:teuthology.parallel:result is None 2023-01-25T09:39:54.190 INFO:teuthology.orchestra.run.smithi035.stdout:60129542147 2023-01-25T09:39:54.191 INFO:teuthology.orchestra.run.smithi035.stdout:60129542147 2023-01-25T09:39:54.207 INFO:teuthology.orchestra.run.smithi035.stdout:55834574852 2023-01-25T09:39:54.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.3 2023-01-25T09:39:54.209 DEBUG:teuthology.parallel:result is None 2023-01-25T09:39:54.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.6 2023-01-25T09:39:54.210 DEBUG:teuthology.parallel:result is None 2023-01-25T09:39:54.218 INFO:teuthology.orchestra.run.smithi035.stdout:60129542147 2023-01-25T09:39:54.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2023-01-25T09:39:54.221 DEBUG:teuthology.parallel:result is None 2023-01-25T09:39:54.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.0 2023-01-25T09:39:54.230 DEBUG:teuthology.parallel:result is None 2023-01-25T09:39:54.247 INFO:teuthology.orchestra.run.smithi035.stdout:60129542147 2023-01-25T09:39:54.248 INFO:teuthology.orchestra.run.smithi035.stdout:60129542146 2023-01-25T09:39:54.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.1 2023-01-25T09:39:54.259 DEBUG:teuthology.parallel:result is None 2023-01-25T09:39:54.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542146 for osd.4 2023-01-25T09:39:54.261 DEBUG:teuthology.parallel:result is None 2023-01-25T09:39:54.265 INFO:teuthology.orchestra.run.smithi035.stdout:60129542146 2023-01-25T09:39:54.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542146 for osd.7 2023-01-25T09:39:54.279 DEBUG:teuthology.parallel:result is None 2023-01-25T09:39:54.279 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T09:39:54.280 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T09:39:54.600 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:54.601 INFO:teuthology.orchestra.run.smithi035.stderr:dumped all 2023-01-25T09:39:54.611 INFO:teuthology.orchestra.run.smithi035.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2023-01-25T09:39:53.784660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":43868,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":40320,"kb_avail":754930852,"statfs":{"total":773094113280,"available":773049192448,"internally_reserved":0,"allocated":2596864,"data_stored":1758145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41287680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.006060+0000","last_change":"2023-01-25T09:39:50.911830+0000","last_active":"2023-01-25T09:39:52.006060+0000","last_peered":"2023-01-25T09:39:52.006060+0000","last_clean":"2023-01-25T09:39:52.006060+0000","last_became_active":"2023-01-25T09:39:50.911357+0000","last_became_peered":"2023-01-25T09:39:50.911357+0000","last_unstale":"2023-01-25T09:39:52.006060+0000","last_undegraded":"2023-01-25T09:39:52.006060+0000","last_fullsized":"2023-01-25T09:39:52.006060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:40:52.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.006115+0000","last_change":"2023-01-25T09:39:50.910754+0000","last_active":"2023-01-25T09:39:52.006115+0000","last_peered":"2023-01-25T09:39:52.006115+0000","last_clean":"2023-01-25T09:39:52.006115+0000","last_became_active":"2023-01-25T09:39:50.910276+0000","last_became_peered":"2023-01-25T09:39:50.910276+0000","last_unstale":"2023-01-25T09:39:52.006115+0000","last_undegraded":"2023-01-25T09:39:52.006115+0000","last_fullsized":"2023-01-25T09:39:52.006115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:15.729112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003832+0000","last_change":"2023-01-25T09:39:51.736356+0000","last_active":"2023-01-25T09:39:52.003832+0000","last_peered":"2023-01-25T09:39:52.003832+0000","last_clean":"2023-01-25T09:39:52.003832+0000","last_became_active":"2023-01-25T09:39:51.735621+0000","last_became_peered":"2023-01-25T09:39:51.735621+0000","last_unstale":"2023-01-25T09:39:52.003832+0000","last_undegraded":"2023-01-25T09:39:52.003832+0000","last_fullsized":"2023-01-25T09:39:52.003832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:04.039410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003716+0000","last_change":"2023-01-25T09:39:50.911162+0000","last_active":"2023-01-25T09:39:52.003716+0000","last_peered":"2023-01-25T09:39:52.003716+0000","last_clean":"2023-01-25T09:39:52.003716+0000","last_became_active":"2023-01-25T09:39:50.910725+0000","last_became_peered":"2023-01-25T09:39:50.910725+0000","last_unstale":"2023-01-25T09:39:52.003716+0000","last_undegraded":"2023-01-25T09:39:52.003716+0000","last_fullsized":"2023-01-25T09:39:52.003716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:17.940008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'105","reported_seq":146,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003967+0000","last_change":"2023-01-25T09:39:50.911036+0000","last_active":"2023-01-25T09:39:52.003967+0000","last_peered":"2023-01-25T09:39:52.003967+0000","last_clean":"2023-01-25T09:39:52.003967+0000","last_became_active":"2023-01-25T09:39:50.910566+0000","last_became_peered":"2023-01-25T09:39:50.910566+0000","last_unstale":"2023-01-25T09:39:52.003967+0000","last_undegraded":"2023-01-25T09:39:52.003967+0000","last_fullsized":"2023-01-25T09:39:52.003967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:40:54.895173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:51.925360+0000","last_change":"2023-01-25T09:39:50.909988+0000","last_active":"2023-01-25T09:39:51.925360+0000","last_peered":"2023-01-25T09:39:51.925360+0000","last_clean":"2023-01-25T09:39:51.925360+0000","last_became_active":"2023-01-25T09:39:50.909558+0000","last_became_peered":"2023-01-25T09:39:50.909558+0000","last_unstale":"2023-01-25T09:39:51.925360+0000","last_undegraded":"2023-01-25T09:39:51.925360+0000","last_fullsized":"2023-01-25T09:39:51.925360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:07.233941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003962+0000","last_change":"2023-01-25T09:39:50.912859+0000","last_active":"2023-01-25T09:39:52.003962+0000","last_peered":"2023-01-25T09:39:52.003962+0000","last_clean":"2023-01-25T09:39:52.003962+0000","last_became_active":"2023-01-25T09:39:50.912439+0000","last_became_peered":"2023-01-25T09:39:50.912439+0000","last_unstale":"2023-01-25T09:39:52.003962+0000","last_undegraded":"2023-01-25T09:39:52.003962+0000","last_fullsized":"2023-01-25T09:39:52.003962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:40:51.378366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:51.921893+0000","last_change":"2023-01-25T09:39:51.737552+0000","last_active":"2023-01-25T09:39:51.921893+0000","last_peered":"2023-01-25T09:39:51.921893+0000","last_clean":"2023-01-25T09:39:51.921893+0000","last_became_active":"2023-01-25T09:39:51.736515+0000","last_became_peered":"2023-01-25T09:39:51.736515+0000","last_unstale":"2023-01-25T09:39:51.921893+0000","last_undegraded":"2023-01-25T09:39:51.921893+0000","last_fullsized":"2023-01-25T09:39:51.921893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:12.027639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.004058+0000","last_change":"2023-01-25T09:39:50.914405+0000","last_active":"2023-01-25T09:39:52.004058+0000","last_peered":"2023-01-25T09:39:52.004058+0000","last_clean":"2023-01-25T09:39:52.004058+0000","last_became_active":"2023-01-25T09:39:50.914066+0000","last_became_peered":"2023-01-25T09:39:50.914066+0000","last_unstale":"2023-01-25T09:39:52.004058+0000","last_undegraded":"2023-01-25T09:39:52.004058+0000","last_fullsized":"2023-01-25T09:39:52.004058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:17.630297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1413120,"data_stored":1402464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":3,"acting":3,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542146,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6240,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94365600,"statfs":{"total":96636764160,"available":96630374400,"internally_reserved":0,"allocated":618496,"data_stored":511065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5084,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366756,"statfs":{"total":96636764160,"available":96631558144,"internally_reserved":0,"allocated":151552,"data_stored":47614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]}]},{"osd":5,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5012,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366828,"statfs":{"total":96636764160,"available":96631631872,"internally_reserved":0,"allocated":143360,"data_stored":42616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7489999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.181}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]}]},{"osd":4,"up_from":14,"seq":60129542146,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5012,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366828,"statfs":{"total":96636764160,"available":96631631872,"internally_reserved":0,"allocated":143360,"data_stored":42616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6248,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94365592,"statfs":{"total":96636764160,"available":96630366208,"internally_reserved":0,"allocated":626688,"data_stored":516063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6240,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94365600,"statfs":{"total":96636764160,"available":96630374400,"internally_reserved":0,"allocated":618496,"data_stored":511065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7370000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5008,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366832,"statfs":{"total":96636764160,"available":96631635968,"internally_reserved":0,"allocated":139264,"data_stored":38531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T09:39:54.613 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T09:39:54.896 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:54.898 INFO:teuthology.orchestra.run.smithi035.stderr:dumped all 2023-01-25T09:39:54.909 INFO:teuthology.orchestra.run.smithi035.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2023-01-25T09:39:53.784660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":43868,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":40320,"kb_avail":754930852,"statfs":{"total":773094113280,"available":773049192448,"internally_reserved":0,"allocated":2596864,"data_stored":1758145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41287680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.006060+0000","last_change":"2023-01-25T09:39:50.911830+0000","last_active":"2023-01-25T09:39:52.006060+0000","last_peered":"2023-01-25T09:39:52.006060+0000","last_clean":"2023-01-25T09:39:52.006060+0000","last_became_active":"2023-01-25T09:39:50.911357+0000","last_became_peered":"2023-01-25T09:39:50.911357+0000","last_unstale":"2023-01-25T09:39:52.006060+0000","last_undegraded":"2023-01-25T09:39:52.006060+0000","last_fullsized":"2023-01-25T09:39:52.006060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:40:52.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.006115+0000","last_change":"2023-01-25T09:39:50.910754+0000","last_active":"2023-01-25T09:39:52.006115+0000","last_peered":"2023-01-25T09:39:52.006115+0000","last_clean":"2023-01-25T09:39:52.006115+0000","last_became_active":"2023-01-25T09:39:50.910276+0000","last_became_peered":"2023-01-25T09:39:50.910276+0000","last_unstale":"2023-01-25T09:39:52.006115+0000","last_undegraded":"2023-01-25T09:39:52.006115+0000","last_fullsized":"2023-01-25T09:39:52.006115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:15.729112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003832+0000","last_change":"2023-01-25T09:39:51.736356+0000","last_active":"2023-01-25T09:39:52.003832+0000","last_peered":"2023-01-25T09:39:52.003832+0000","last_clean":"2023-01-25T09:39:52.003832+0000","last_became_active":"2023-01-25T09:39:51.735621+0000","last_became_peered":"2023-01-25T09:39:51.735621+0000","last_unstale":"2023-01-25T09:39:52.003832+0000","last_undegraded":"2023-01-25T09:39:52.003832+0000","last_fullsized":"2023-01-25T09:39:52.003832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:04.039410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003716+0000","last_change":"2023-01-25T09:39:50.911162+0000","last_active":"2023-01-25T09:39:52.003716+0000","last_peered":"2023-01-25T09:39:52.003716+0000","last_clean":"2023-01-25T09:39:52.003716+0000","last_became_active":"2023-01-25T09:39:50.910725+0000","last_became_peered":"2023-01-25T09:39:50.910725+0000","last_unstale":"2023-01-25T09:39:52.003716+0000","last_undegraded":"2023-01-25T09:39:52.003716+0000","last_fullsized":"2023-01-25T09:39:52.003716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:17.940008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'105","reported_seq":146,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003967+0000","last_change":"2023-01-25T09:39:50.911036+0000","last_active":"2023-01-25T09:39:52.003967+0000","last_peered":"2023-01-25T09:39:52.003967+0000","last_clean":"2023-01-25T09:39:52.003967+0000","last_became_active":"2023-01-25T09:39:50.910566+0000","last_became_peered":"2023-01-25T09:39:50.910566+0000","last_unstale":"2023-01-25T09:39:52.003967+0000","last_undegraded":"2023-01-25T09:39:52.003967+0000","last_fullsized":"2023-01-25T09:39:52.003967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:40:54.895173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:51.925360+0000","last_change":"2023-01-25T09:39:50.909988+0000","last_active":"2023-01-25T09:39:51.925360+0000","last_peered":"2023-01-25T09:39:51.925360+0000","last_clean":"2023-01-25T09:39:51.925360+0000","last_became_active":"2023-01-25T09:39:50.909558+0000","last_became_peered":"2023-01-25T09:39:50.909558+0000","last_unstale":"2023-01-25T09:39:51.925360+0000","last_undegraded":"2023-01-25T09:39:51.925360+0000","last_fullsized":"2023-01-25T09:39:51.925360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:07.233941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003962+0000","last_change":"2023-01-25T09:39:50.912859+0000","last_active":"2023-01-25T09:39:52.003962+0000","last_peered":"2023-01-25T09:39:52.003962+0000","last_clean":"2023-01-25T09:39:52.003962+0000","last_became_active":"2023-01-25T09:39:50.912439+0000","last_became_peered":"2023-01-25T09:39:50.912439+0000","last_unstale":"2023-01-25T09:39:52.003962+0000","last_undegraded":"2023-01-25T09:39:52.003962+0000","last_fullsized":"2023-01-25T09:39:52.003962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:40:51.378366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:51.921893+0000","last_change":"2023-01-25T09:39:51.737552+0000","last_active":"2023-01-25T09:39:51.921893+0000","last_peered":"2023-01-25T09:39:51.921893+0000","last_clean":"2023-01-25T09:39:51.921893+0000","last_became_active":"2023-01-25T09:39:51.736515+0000","last_became_peered":"2023-01-25T09:39:51.736515+0000","last_unstale":"2023-01-25T09:39:51.921893+0000","last_undegraded":"2023-01-25T09:39:51.921893+0000","last_fullsized":"2023-01-25T09:39:51.921893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:12.027639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.004058+0000","last_change":"2023-01-25T09:39:50.914405+0000","last_active":"2023-01-25T09:39:52.004058+0000","last_peered":"2023-01-25T09:39:52.004058+0000","last_clean":"2023-01-25T09:39:52.004058+0000","last_became_active":"2023-01-25T09:39:50.914066+0000","last_became_peered":"2023-01-25T09:39:50.914066+0000","last_unstale":"2023-01-25T09:39:52.004058+0000","last_undegraded":"2023-01-25T09:39:52.004058+0000","last_fullsized":"2023-01-25T09:39:52.004058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:17.630297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1413120,"data_stored":1402464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":3,"acting":3,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542146,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6240,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94365600,"statfs":{"total":96636764160,"available":96630374400,"internally_reserved":0,"allocated":618496,"data_stored":511065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5084,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366756,"statfs":{"total":96636764160,"available":96631558144,"internally_reserved":0,"allocated":151552,"data_stored":47614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]}]},{"osd":5,"up_from":14,"seq":60129542146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5012,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366828,"statfs":{"total":96636764160,"available":96631631872,"internally_reserved":0,"allocated":143360,"data_stored":42616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7489999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.181}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]}]},{"osd":4,"up_from":14,"seq":60129542146,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5012,"kb_used_data":140,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366828,"statfs":{"total":96636764160,"available":96631631872,"internally_reserved":0,"allocated":143360,"data_stored":42616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6248,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94365592,"statfs":{"total":96636764160,"available":96630366208,"internally_reserved":0,"allocated":626688,"data_stored":516063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6240,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":94365600,"statfs":{"total":96636764160,"available":96630374400,"internally_reserved":0,"allocated":618496,"data_stored":511065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7370000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5008,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366832,"statfs":{"total":96636764160,"available":96631635968,"internally_reserved":0,"allocated":139264,"data_stored":38531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T09:39:54.911 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T09:39:54.911 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-25T09:39:54.911 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-01-25T09:39:54.912 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-01-25T09:39:55.217 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:55.218 INFO:teuthology.orchestra.run.smithi035.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-25T09:39:55.231 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-01-25T09:39:55.231 INFO:teuthology.run_tasks:Running task thrashosds... 2023-01-25T09:39:55.242 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 3, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-01-25T09:39:55.243 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-yuri6-testing-2023-01-24-0746'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'ms type': 'async', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore queue throttle high multiple': 2, 'filestore queue throttle max multiple': 10, 'journal throttle high multiple': 2, 'journal throttle max multiple': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 9, 'osd max markdown count': 1000, 'osd max scrubs': 3, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'mon_bind_msgr2': False, 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4}, 'workunit': {'branch': 'wip-yuri6-testing-2023-01-24-0746', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}} 2023-01-25T09:39:55.243 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 3, 'chance_pgpnum_fix': 1, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4} 2023-01-25T09:39:55.244 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-01-25T09:39:55.567 INFO:tasks.thrashosds:Beginning thrashosds... 2023-01-25T09:39:55.568 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T09:39:55.568 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T09:39:55.842 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:55.845 INFO:teuthology.orchestra.run.smithi035.stderr:dumped all 2023-01-25T09:39:55.855 INFO:teuthology.orchestra.run.smithi035.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-25T09:39:55.785170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":44152,"kb_used_data":2748,"kb_used_omap":0,"kb_used_meta":40640,"kb_avail":754930568,"statfs":{"total":773094113280,"available":773048901632,"internally_reserved":0,"allocated":2813952,"data_stored":1962457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41615360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000510"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.006060+0000","last_change":"2023-01-25T09:39:50.911830+0000","last_active":"2023-01-25T09:39:52.006060+0000","last_peered":"2023-01-25T09:39:52.006060+0000","last_clean":"2023-01-25T09:39:52.006060+0000","last_became_active":"2023-01-25T09:39:50.911357+0000","last_became_peered":"2023-01-25T09:39:50.911357+0000","last_unstale":"2023-01-25T09:39:52.006060+0000","last_undegraded":"2023-01-25T09:39:52.006060+0000","last_fullsized":"2023-01-25T09:39:52.006060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:40:52.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.006115+0000","last_change":"2023-01-25T09:39:50.910754+0000","last_active":"2023-01-25T09:39:52.006115+0000","last_peered":"2023-01-25T09:39:52.006115+0000","last_clean":"2023-01-25T09:39:52.006115+0000","last_became_active":"2023-01-25T09:39:50.910276+0000","last_became_peered":"2023-01-25T09:39:50.910276+0000","last_unstale":"2023-01-25T09:39:52.006115+0000","last_undegraded":"2023-01-25T09:39:52.006115+0000","last_fullsized":"2023-01-25T09:39:52.006115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:15.729112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003832+0000","last_change":"2023-01-25T09:39:51.736356+0000","last_active":"2023-01-25T09:39:52.003832+0000","last_peered":"2023-01-25T09:39:52.003832+0000","last_clean":"2023-01-25T09:39:52.003832+0000","last_became_active":"2023-01-25T09:39:51.735621+0000","last_became_peered":"2023-01-25T09:39:51.735621+0000","last_unstale":"2023-01-25T09:39:52.003832+0000","last_undegraded":"2023-01-25T09:39:52.003832+0000","last_fullsized":"2023-01-25T09:39:52.003832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:04.039410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003716+0000","last_change":"2023-01-25T09:39:50.911162+0000","last_active":"2023-01-25T09:39:52.003716+0000","last_peered":"2023-01-25T09:39:52.003716+0000","last_clean":"2023-01-25T09:39:52.003716+0000","last_became_active":"2023-01-25T09:39:50.910725+0000","last_became_peered":"2023-01-25T09:39:50.910725+0000","last_unstale":"2023-01-25T09:39:52.003716+0000","last_undegraded":"2023-01-25T09:39:52.003716+0000","last_fullsized":"2023-01-25T09:39:52.003716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:17.940008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":161,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.707363+0000","last_change":"2023-01-25T09:39:50.911036+0000","last_active":"2023-01-25T09:39:52.707363+0000","last_peered":"2023-01-25T09:39:52.707363+0000","last_clean":"2023-01-25T09:39:52.707363+0000","last_became_active":"2023-01-25T09:39:50.910566+0000","last_became_peered":"2023-01-25T09:39:50.910566+0000","last_unstale":"2023-01-25T09:39:52.707363+0000","last_undegraded":"2023-01-25T09:39:52.707363+0000","last_fullsized":"2023-01-25T09:39:52.707363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:40:54.895173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:51.925360+0000","last_change":"2023-01-25T09:39:50.909988+0000","last_active":"2023-01-25T09:39:51.925360+0000","last_peered":"2023-01-25T09:39:51.925360+0000","last_clean":"2023-01-25T09:39:51.925360+0000","last_became_active":"2023-01-25T09:39:50.909558+0000","last_became_peered":"2023-01-25T09:39:50.909558+0000","last_unstale":"2023-01-25T09:39:51.925360+0000","last_undegraded":"2023-01-25T09:39:51.925360+0000","last_fullsized":"2023-01-25T09:39:51.925360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:07.233941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003962+0000","last_change":"2023-01-25T09:39:50.912859+0000","last_active":"2023-01-25T09:39:52.003962+0000","last_peered":"2023-01-25T09:39:52.003962+0000","last_clean":"2023-01-25T09:39:52.003962+0000","last_became_active":"2023-01-25T09:39:50.912439+0000","last_became_peered":"2023-01-25T09:39:50.912439+0000","last_unstale":"2023-01-25T09:39:52.003962+0000","last_undegraded":"2023-01-25T09:39:52.003962+0000","last_fullsized":"2023-01-25T09:39:52.003962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:40:51.378366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:51.921893+0000","last_change":"2023-01-25T09:39:51.737552+0000","last_active":"2023-01-25T09:39:51.921893+0000","last_peered":"2023-01-25T09:39:51.921893+0000","last_clean":"2023-01-25T09:39:51.921893+0000","last_became_active":"2023-01-25T09:39:51.736515+0000","last_became_peered":"2023-01-25T09:39:51.736515+0000","last_unstale":"2023-01-25T09:39:51.921893+0000","last_undegraded":"2023-01-25T09:39:51.921893+0000","last_fullsized":"2023-01-25T09:39:51.921893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:12.027639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.004058+0000","last_change":"2023-01-25T09:39:50.914405+0000","last_active":"2023-01-25T09:39:52.004058+0000","last_peered":"2023-01-25T09:39:52.004058+0000","last_clean":"2023-01-25T09:39:52.004058+0000","last_became_active":"2023-01-25T09:39:50.914066+0000","last_became_peered":"2023-01-25T09:39:50.914066+0000","last_unstale":"2023-01-25T09:39:52.004058+0000","last_undegraded":"2023-01-25T09:39:52.004058+0000","last_fullsized":"2023-01-25T09:39:52.004058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:17.630297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6500,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94365340,"statfs":{"total":96636764160,"available":96630108160,"internally_reserved":0,"allocated":688128,"data_stored":577503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5084,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366756,"statfs":{"total":96636764160,"available":96631558144,"internally_reserved":0,"allocated":151552,"data_stored":47614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5084,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366756,"statfs":{"total":96636764160,"available":96631558144,"internally_reserved":0,"allocated":151552,"data_stored":47614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5084,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366756,"statfs":{"total":96636764160,"available":96631558144,"internally_reserved":0,"allocated":151552,"data_stored":47614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6184,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94365656,"statfs":{"total":96636764160,"available":96630431744,"internally_reserved":0,"allocated":688128,"data_stored":577503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6184,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94365656,"statfs":{"total":96636764160,"available":96630431744,"internally_reserved":0,"allocated":688128,"data_stored":577503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5008,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366832,"statfs":{"total":96636764160,"available":96631635968,"internally_reserved":0,"allocated":139264,"data_stored":38531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T09:39:55.857 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T09:39:56.134 INFO:teuthology.orchestra.run.smithi035.stdout: 2023-01-25T09:39:56.138 INFO:teuthology.orchestra.run.smithi035.stderr:dumped all 2023-01-25T09:39:56.152 INFO:teuthology.orchestra.run.smithi035.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-25T09:39:55.785170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":44152,"kb_used_data":2748,"kb_used_omap":0,"kb_used_meta":40640,"kb_avail":754930568,"statfs":{"total":773094113280,"available":773048901632,"internally_reserved":0,"allocated":2813952,"data_stored":1962457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41615360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000510"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.006060+0000","last_change":"2023-01-25T09:39:50.911830+0000","last_active":"2023-01-25T09:39:52.006060+0000","last_peered":"2023-01-25T09:39:52.006060+0000","last_clean":"2023-01-25T09:39:52.006060+0000","last_became_active":"2023-01-25T09:39:50.911357+0000","last_became_peered":"2023-01-25T09:39:50.911357+0000","last_unstale":"2023-01-25T09:39:52.006060+0000","last_undegraded":"2023-01-25T09:39:52.006060+0000","last_fullsized":"2023-01-25T09:39:52.006060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:40:52.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.006115+0000","last_change":"2023-01-25T09:39:50.910754+0000","last_active":"2023-01-25T09:39:52.006115+0000","last_peered":"2023-01-25T09:39:52.006115+0000","last_clean":"2023-01-25T09:39:52.006115+0000","last_became_active":"2023-01-25T09:39:50.910276+0000","last_became_peered":"2023-01-25T09:39:50.910276+0000","last_unstale":"2023-01-25T09:39:52.006115+0000","last_undegraded":"2023-01-25T09:39:52.006115+0000","last_fullsized":"2023-01-25T09:39:52.006115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:15.729112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003832+0000","last_change":"2023-01-25T09:39:51.736356+0000","last_active":"2023-01-25T09:39:52.003832+0000","last_peered":"2023-01-25T09:39:52.003832+0000","last_clean":"2023-01-25T09:39:52.003832+0000","last_became_active":"2023-01-25T09:39:51.735621+0000","last_became_peered":"2023-01-25T09:39:51.735621+0000","last_unstale":"2023-01-25T09:39:52.003832+0000","last_undegraded":"2023-01-25T09:39:52.003832+0000","last_fullsized":"2023-01-25T09:39:52.003832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:04.039410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003716+0000","last_change":"2023-01-25T09:39:50.911162+0000","last_active":"2023-01-25T09:39:52.003716+0000","last_peered":"2023-01-25T09:39:52.003716+0000","last_clean":"2023-01-25T09:39:52.003716+0000","last_became_active":"2023-01-25T09:39:50.910725+0000","last_became_peered":"2023-01-25T09:39:50.910725+0000","last_unstale":"2023-01-25T09:39:52.003716+0000","last_undegraded":"2023-01-25T09:39:52.003716+0000","last_fullsized":"2023-01-25T09:39:52.003716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:17.940008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":161,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.707363+0000","last_change":"2023-01-25T09:39:50.911036+0000","last_active":"2023-01-25T09:39:52.707363+0000","last_peered":"2023-01-25T09:39:52.707363+0000","last_clean":"2023-01-25T09:39:52.707363+0000","last_became_active":"2023-01-25T09:39:50.910566+0000","last_became_peered":"2023-01-25T09:39:50.910566+0000","last_unstale":"2023-01-25T09:39:52.707363+0000","last_undegraded":"2023-01-25T09:39:52.707363+0000","last_fullsized":"2023-01-25T09:39:52.707363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:40:54.895173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:51.925360+0000","last_change":"2023-01-25T09:39:50.909988+0000","last_active":"2023-01-25T09:39:51.925360+0000","last_peered":"2023-01-25T09:39:51.925360+0000","last_clean":"2023-01-25T09:39:51.925360+0000","last_became_active":"2023-01-25T09:39:50.909558+0000","last_became_peered":"2023-01-25T09:39:50.909558+0000","last_unstale":"2023-01-25T09:39:51.925360+0000","last_undegraded":"2023-01-25T09:39:51.925360+0000","last_fullsized":"2023-01-25T09:39:51.925360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:07.233941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.003962+0000","last_change":"2023-01-25T09:39:50.912859+0000","last_active":"2023-01-25T09:39:52.003962+0000","last_peered":"2023-01-25T09:39:52.003962+0000","last_clean":"2023-01-25T09:39:52.003962+0000","last_became_active":"2023-01-25T09:39:50.912439+0000","last_became_peered":"2023-01-25T09:39:50.912439+0000","last_unstale":"2023-01-25T09:39:52.003962+0000","last_undegraded":"2023-01-25T09:39:52.003962+0000","last_fullsized":"2023-01-25T09:39:52.003962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:40:51.378366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:51.921893+0000","last_change":"2023-01-25T09:39:51.737552+0000","last_active":"2023-01-25T09:39:51.921893+0000","last_peered":"2023-01-25T09:39:51.921893+0000","last_clean":"2023-01-25T09:39:51.921893+0000","last_became_active":"2023-01-25T09:39:51.736515+0000","last_became_peered":"2023-01-25T09:39:51.736515+0000","last_unstale":"2023-01-25T09:39:51.921893+0000","last_undegraded":"2023-01-25T09:39:51.921893+0000","last_fullsized":"2023-01-25T09:39:51.921893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:12.027639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2],"acting":[5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:39:52.004058+0000","last_change":"2023-01-25T09:39:50.914405+0000","last_active":"2023-01-25T09:39:52.004058+0000","last_peered":"2023-01-25T09:39:52.004058+0000","last_clean":"2023-01-25T09:39:52.004058+0000","last_became_active":"2023-01-25T09:39:50.914066+0000","last_became_peered":"2023-01-25T09:39:50.914066+0000","last_unstale":"2023-01-25T09:39:52.004058+0000","last_undegraded":"2023-01-25T09:39:52.004058+0000","last_fullsized":"2023-01-25T09:39:52.004058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:39:49.880773+0000","last_clean_scrub_stamp":"2023-01-25T09:39:49.880773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-25T09:41:17.630297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6500,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94365340,"statfs":{"total":96636764160,"available":96630108160,"internally_reserved":0,"allocated":688128,"data_stored":577503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5084,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366756,"statfs":{"total":96636764160,"available":96631558144,"internally_reserved":0,"allocated":151552,"data_stored":47614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5084,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366756,"statfs":{"total":96636764160,"available":96631558144,"internally_reserved":0,"allocated":151552,"data_stored":47614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366816,"statfs":{"total":96636764160,"available":96631619584,"internally_reserved":0,"allocated":155648,"data_stored":48575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5084,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366756,"statfs":{"total":96636764160,"available":96631558144,"internally_reserved":0,"allocated":151552,"data_stored":47614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6184,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94365656,"statfs":{"total":96636764160,"available":96630431744,"internally_reserved":0,"allocated":688128,"data_stored":577503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6184,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94365656,"statfs":{"total":96636764160,"available":96630431744,"internally_reserved":0,"allocated":688128,"data_stored":577503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5008,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366832,"statfs":{"total":96636764160,"available":96631635968,"internally_reserved":0,"allocated":139264,"data_stored":38531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.639}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T09:39:56.154 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T09:39:56.154 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-01-25T09:39:56.443 INFO:teuthology.orchestra.run.smithi035.stdout:epoch 18 2023-01-25T09:39:56.444 INFO:teuthology.orchestra.run.smithi035.stdout:fsid 97131e4b-ba28-4ab8-a3d7-d027cd4303dd 2023-01-25T09:39:56.444 INFO:teuthology.orchestra.run.smithi035.stdout:created 2023-01-25T09:39:38.460356+0000 2023-01-25T09:39:56.444 INFO:teuthology.orchestra.run.smithi035.stdout:modified 2023-01-25T09:39:51.905042+0000 2023-01-25T09:39:56.445 INFO:teuthology.orchestra.run.smithi035.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-01-25T09:39:56.445 INFO:teuthology.orchestra.run.smithi035.stdout:crush_version 5 2023-01-25T09:39:56.445 INFO:teuthology.orchestra.run.smithi035.stdout:full_ratio 0.95 2023-01-25T09:39:56.445 INFO:teuthology.orchestra.run.smithi035.stdout:backfillfull_ratio 0.9 2023-01-25T09:39:56.445 INFO:teuthology.orchestra.run.smithi035.stdout:nearfull_ratio 0.85 2023-01-25T09:39:56.446 INFO:teuthology.orchestra.run.smithi035.stdout:require_min_compat_client luminous 2023-01-25T09:39:56.446 INFO:teuthology.orchestra.run.smithi035.stdout:min_compat_client jewel 2023-01-25T09:39:56.446 INFO:teuthology.orchestra.run.smithi035.stdout:require_osd_release reef 2023-01-25T09:39:56.446 INFO:teuthology.orchestra.run.smithi035.stdout:stretch_mode_enabled false 2023-01-25T09:39:56.446 INFO:teuthology.orchestra.run.smithi035.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 application rbd 2023-01-25T09:39:56.447 INFO:teuthology.orchestra.run.smithi035.stdout:pool 2 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr 2023-01-25T09:39:56.447 INFO:teuthology.orchestra.run.smithi035.stdout:max_osd 8 2023-01-25T09:39:56.447 INFO:teuthology.orchestra.run.smithi035.stdout:osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.35:6800/27884 v1:172.21.15.35:6801/27884 exists,up 1dc18a6c-8ced-4d84-a47f-65ef5b240951 2023-01-25T09:39:56.447 INFO:teuthology.orchestra.run.smithi035.stdout:osd.1 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v1:172.21.15.35:6808/27885 v1:172.21.15.35:6809/27885 exists,up d7f82dcf-6f57-4086-8cf2-417cbe173dd1 2023-01-25T09:39:56.447 INFO:teuthology.orchestra.run.smithi035.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.35:6804/27887 v1:172.21.15.35:6805/27887 exists,up f574de08-f0ef-436d-bf0f-8521c01a20d0 2023-01-25T09:39:56.448 INFO:teuthology.orchestra.run.smithi035.stdout:osd.3 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v1:172.21.15.35:6812/27886 v1:172.21.15.35:6813/27886 exists,up e704cff4-131e-4001-9997-fe3a18f603a9 2023-01-25T09:39:56.448 INFO:teuthology.orchestra.run.smithi035.stdout:osd.4 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v1:172.21.15.138:6800/28064 v1:172.21.15.138:6801/28064 exists,up cdd53f9e-272e-4395-943f-a2d67a590060 2023-01-25T09:39:56.448 INFO:teuthology.orchestra.run.smithi035.stdout:osd.5 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v1:172.21.15.138:6804/28066 v1:172.21.15.138:6805/28066 exists,up 4cca5da7-47ab-4f4f-bbb9-1a9927162000 2023-01-25T09:39:56.448 INFO:teuthology.orchestra.run.smithi035.stdout:osd.6 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v1:172.21.15.138:6808/28065 v1:172.21.15.138:6809/28065 exists,up fb4766e6-92ef-46c6-b052-99a7e95157f3 2023-01-25T09:39:56.448 INFO:teuthology.orchestra.run.smithi035.stdout:osd.7 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v1:172.21.15.138:6812/28067 v1:172.21.15.138:6813/28067 exists,up f0f7974b-e2de-43a8-a643-2d3b697c3d74 2023-01-25T09:39:56.458 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.35:6800/27884 v1:172.21.15.35:6801/27884 exists,up 1dc18a6c-8ced-4d84-a47f-65ef5b240951', 'osd.1 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v1:172.21.15.35:6808/27885 v1:172.21.15.35:6809/27885 exists,up d7f82dcf-6f57-4086-8cf2-417cbe173dd1', 'osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.35:6804/27887 v1:172.21.15.35:6805/27887 exists,up f574de08-f0ef-436d-bf0f-8521c01a20d0', 'osd.3 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v1:172.21.15.35:6812/27886 v1:172.21.15.35:6813/27886 exists,up e704cff4-131e-4001-9997-fe3a18f603a9', 'osd.4 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v1:172.21.15.138:6800/28064 v1:172.21.15.138:6801/28064 exists,up cdd53f9e-272e-4395-943f-a2d67a590060', 'osd.5 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v1:172.21.15.138:6804/28066 v1:172.21.15.138:6805/28066 exists,up 4cca5da7-47ab-4f4f-bbb9-1a9927162000', 'osd.6 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v1:172.21.15.138:6808/28065 v1:172.21.15.138:6809/28065 exists,up fb4766e6-92ef-46c6-b052-99a7e95157f3', 'osd.7 up in weight 1 up_from 14 up_thru 16 down_at 0 last_clean_interval [0,0) v1:172.21.15.138:6812/28067 v1:172.21.15.138:6813/28067 exists,up f0f7974b-e2de-43a8-a643-2d3b697c3d74'] 2023-01-25T09:39:56.458 DEBUG:teuthology.orchestra.run.smithi035:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-01-25T09:39:56.574 INFO:teuthology.orchestra.run.smithi035.stdout:{ 2023-01-25T09:39:56.574 INFO:teuthology.orchestra.run.smithi035.stdout: "name": "mon.a", 2023-01-25T09:39:56.575 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster": "ceph", 2023-01-25T09:39:56.575 INFO:teuthology.orchestra.run.smithi035.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-01-25T09:39:56.575 INFO:teuthology.orchestra.run.smithi035.stdout: "admin_socket_mode": "", 2023-01-25T09:39:56.575 INFO:teuthology.orchestra.run.smithi035.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-01-25T09:39:56.575 INFO:teuthology.orchestra.run.smithi035.stdout: "auth_client_required": "cephx, none", 2023-01-25T09:39:56.576 INFO:teuthology.orchestra.run.smithi035.stdout: "auth_cluster_required": "cephx", 2023-01-25T09:39:56.576 INFO:teuthology.orchestra.run.smithi035.stdout: "auth_debug": "true", 2023-01-25T09:39:56.576 INFO:teuthology.orchestra.run.smithi035.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-01-25T09:39:56.577 INFO:teuthology.orchestra.run.smithi035.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-01-25T09:39:56.577 INFO:teuthology.orchestra.run.smithi035.stdout: "auth_service_required": "cephx", 2023-01-25T09:39:56.577 INFO:teuthology.orchestra.run.smithi035.stdout: "auth_service_ticket_ttl": "240.000000", 2023-01-25T09:39:56.577 INFO:teuthology.orchestra.run.smithi035.stdout: "auth_supported": "cephx", 2023-01-25T09:39:56.577 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_aio": "true", 2023-01-25T09:39:56.578 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_aio_max_queue_depth": "1024", 2023-01-25T09:39:56.578 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_aio_poll_ms": "250", 2023-01-25T09:39:56.578 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_aio_reap_max": "16", 2023-01-25T09:39:56.578 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_async_discard": "false", 2023-01-25T09:39:56.579 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_block_size": "4096", 2023-01-25T09:39:56.579 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_debug_aio": "false", 2023-01-25T09:39:56.579 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-01-25T09:39:56.579 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-01-25T09:39:56.579 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_debug_inflight_ios": "false", 2023-01-25T09:39:56.580 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_enable_discard": "false", 2023-01-25T09:39:56.580 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_flock_retry": "3", 2023-01-25T09:39:56.580 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_flock_retry_interval": "0.100000", 2023-01-25T09:39:56.580 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_inject_crash": "0", 2023-01-25T09:39:56.580 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_inject_crash_flush_delay": "2", 2023-01-25T09:39:56.581 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_ioring": "false", 2023-01-25T09:39:56.581 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_ioring_hipri": "false", 2023-01-25T09:39:56.581 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_ioring_sqthread_poll": "false", 2023-01-25T09:39:56.581 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-01-25T09:39:56.581 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_read_buffer_alignment": "4096", 2023-01-25T09:39:56.582 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-01-25T09:39:56.582 INFO:teuthology.orchestra.run.smithi035.stdout: "bdev_type": "", 2023-01-25T09:39:56.582 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_alloc_size": "1048576", 2023-01-25T09:39:56.582 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_allocator": "hybrid", 2023-01-25T09:39:56.582 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_buffered_io": "true", 2023-01-25T09:39:56.583 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_check_for_zeros": "false", 2023-01-25T09:39:56.583 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_check_volume_selector_often": "false", 2023-01-25T09:39:56.583 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-01-25T09:39:56.583 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_compact_log_sync": "false", 2023-01-25T09:39:56.583 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-01-25T09:39:56.584 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_log_compact_min_size": "16777216", 2023-01-25T09:39:56.584 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_log_replay_check_allocations": "true", 2023-01-25T09:39:56.584 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_max_log_runway": "4194304", 2023-01-25T09:39:56.584 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_max_prefetch": "1048576", 2023-01-25T09:39:56.584 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_min_flush_size": "524288", 2023-01-25T09:39:56.585 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_min_log_runway": "1048576", 2023-01-25T09:39:56.585 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_replay_recovery": "false", 2023-01-25T09:39:56.585 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-01-25T09:39:56.585 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_shared_alloc_size": "65536", 2023-01-25T09:39:56.585 INFO:teuthology.orchestra.run.smithi035.stdout: "bluefs_sync_write": "false", 2023-01-25T09:39:56.586 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-01-25T09:39:56.586 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-01-25T09:39:56.586 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-01-25T09:39:56.586 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_allocation_from_file": "true", 2023-01-25T09:39:56.587 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_allocator": "hybrid", 2023-01-25T09:39:56.587 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-01-25T09:39:56.587 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-01-25T09:39:56.587 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-01-25T09:39:56.588 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-01-25T09:39:56.588 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-01-25T09:39:56.588 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-01-25T09:39:56.588 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_blobid_prealloc": "10240", 2023-01-25T09:39:56.588 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_block_create": "true", 2023-01-25T09:39:56.589 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_block_db_create": "false", 2023-01-25T09:39:56.589 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_block_db_path": "", 2023-01-25T09:39:56.589 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_block_db_size": "0", 2023-01-25T09:39:56.589 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_block_path": "", 2023-01-25T09:39:56.589 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_block_preallocate_file": "false", 2023-01-25T09:39:56.590 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_block_size": "107374182400", 2023-01-25T09:39:56.590 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_block_wal_create": "false", 2023-01-25T09:39:56.590 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_block_wal_path": "", 2023-01-25T09:39:56.590 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_block_wal_size": "100663296", 2023-01-25T09:39:56.591 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_bluefs": "true", 2023-01-25T09:39:56.591 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-01-25T09:39:56.591 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_bluefs_env_mirror": "false", 2023-01-25T09:39:56.591 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-01-25T09:39:56.591 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-01-25T09:39:56.592 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T09:39:56.592 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T09:39:56.592 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-01-25T09:39:56.592 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-01-25T09:39:56.593 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_autotune": "true", 2023-01-25T09:39:56.593 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-01-25T09:39:56.593 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-01-25T09:39:56.593 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-01-25T09:39:56.594 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-01-25T09:39:56.594 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_size": "0", 2023-01-25T09:39:56.594 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-01-25T09:39:56.594 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-01-25T09:39:56.595 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-01-25T09:39:56.595 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-01-25T09:39:56.595 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cache_type": "2q", 2023-01-25T09:39:56.595 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-01-25T09:39:56.595 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_clone_cow": "true", 2023-01-25T09:39:56.596 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_compression_algorithm": "snappy", 2023-01-25T09:39:56.596 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_compression_max_blob_size": "0", 2023-01-25T09:39:56.596 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-01-25T09:39:56.596 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-01-25T09:39:56.596 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_compression_min_blob_size": "0", 2023-01-25T09:39:56.597 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-01-25T09:39:56.597 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-01-25T09:39:56.597 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_compression_mode": "none", 2023-01-25T09:39:56.597 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-01-25T09:39:56.598 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_csum_type": "crc32c", 2023-01-25T09:39:56.598 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_enforce_settings": "default", 2023-01-25T09:39:56.598 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_freelist": "false", 2023-01-25T09:39:56.598 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_fsck_abort": "false", 2023-01-25T09:39:56.598 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2023-01-25T09:39:56.599 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_inject_bug21040": "false", 2023-01-25T09:39:56.599 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-01-25T09:39:56.599 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_inject_read_err": "false", 2023-01-25T09:39:56.599 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_legacy_omap": "false", 2023-01-25T09:39:56.599 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-01-25T09:39:56.599 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-01-25T09:39:56.600 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-01-25T09:39:56.600 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-01-25T09:39:56.600 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_prefill": "0.000000", 2023-01-25T09:39:56.600 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-01-25T09:39:56.600 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-01-25T09:39:56.601 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-01-25T09:39:56.601 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_small_allocations": "0", 2023-01-25T09:39:56.601 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-01-25T09:39:56.601 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_default_buffered_read": "true", 2023-01-25T09:39:56.601 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_default_buffered_write": "false", 2023-01-25T09:39:56.602 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_deferred_batch_ops": "0", 2023-01-25T09:39:56.602 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-01-25T09:39:56.602 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-01-25T09:39:56.602 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-01-25T09:39:56.602 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-01-25T09:39:56.603 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-01-25T09:39:56.603 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-01-25T09:39:56.603 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-01-25T09:39:56.603 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fail_eio": "false", 2023-01-25T09:39:56.603 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-01-25T09:39:56.603 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-01-25T09:39:56.604 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-01-25T09:39:56.604 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-01-25T09:39:56.604 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_on_mkfs": "true", 2023-01-25T09:39:56.604 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-01-25T09:39:56.605 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_on_mount": "false", 2023-01-25T09:39:56.605 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-01-25T09:39:56.605 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_on_umount": "false", 2023-01-25T09:39:56.605 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-01-25T09:39:56.605 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-01-25T09:39:56.606 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-01-25T09:39:56.606 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-01-25T09:39:56.606 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-01-25T09:39:56.606 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-01-25T09:39:56.606 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-01-25T09:39:56.607 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-01-25T09:39:56.607 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_ignore_data_csum": "false", 2023-01-25T09:39:56.607 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-01-25T09:39:56.607 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_kvbackend": "rocksdb", 2023-01-25T09:39:56.607 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-01-25T09:39:56.608 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-01-25T09:39:56.608 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_log_op_age": "5.000000", 2023-01-25T09:39:56.608 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_max_alloc_size": "0", 2023-01-25T09:39:56.608 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_max_blob_size": "0", 2023-01-25T09:39:56.608 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-01-25T09:39:56.609 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-01-25T09:39:56.609 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_max_defer_interval": "3.000000", 2023-01-25T09:39:56.609 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_max_deferred_txc": "32", 2023-01-25T09:39:56.609 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_min_alloc_size": "0", 2023-01-25T09:39:56.609 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-01-25T09:39:56.610 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-01-25T09:39:56.610 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_nid_prealloc": "1024", 2023-01-25T09:39:56.610 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_prefer_deferred_size": "0", 2023-01-25T09:39:56.610 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-01-25T09:39:56.610 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-01-25T09:39:56.611 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_qfsck_on_mount": "true", 2023-01-25T09:39:56.611 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_retry_disk_reads": "3", 2023-01-25T09:39:56.611 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_rocksdb_cf": "true", 2023-01-25T09:39:56.611 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P", 2023-01-25T09:39:56.611 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=128,min_write_buffer_number_to_merge=16,compaction_style=kCompactionStyleLevel,write_buffer_size=8388608,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0,ttl=21600", 2023-01-25T09:39:56.612 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_rocksdb_options_annex": "", 2023-01-25T09:39:56.612 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_spdk_coremask": "0x1", 2023-01-25T09:39:56.612 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_spdk_io_sleep": "5", 2023-01-25T09:39:56.612 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_spdk_max_io_completion": "0", 2023-01-25T09:39:56.612 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_spdk_mem": "512", 2023-01-25T09:39:56.613 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_sync_submit_transaction": "false", 2023-01-25T09:39:56.613 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_throttle_bytes": "67108864", 2023-01-25T09:39:56.613 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_throttle_cost_per_io": "0", 2023-01-25T09:39:56.613 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-01-25T09:39:56.613 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-01-25T09:39:56.614 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-01-25T09:39:56.614 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-01-25T09:39:56.614 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_tracing": "false", 2023-01-25T09:39:56.614 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-01-25T09:39:56.614 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-01-25T09:39:56.615 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_volume_selection_reserved": "0", 2023-01-25T09:39:56.615 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-01-25T09:39:56.615 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-01-25T09:39:56.615 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-01-25T09:39:56.615 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-01-25T09:39:56.616 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-01-25T09:39:56.616 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-01-25T09:39:56.616 INFO:teuthology.orchestra.run.smithi035.stdout: "bluestore_zero_block_detection": "false", 2023-01-25T09:39:56.616 INFO:teuthology.orchestra.run.smithi035.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-01-25T09:39:56.616 INFO:teuthology.orchestra.run.smithi035.stdout: "cephfs_mirror_action_update_interval": "2", 2023-01-25T09:39:56.617 INFO:teuthology.orchestra.run.smithi035.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-01-25T09:39:56.617 INFO:teuthology.orchestra.run.smithi035.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-01-25T09:39:56.617 INFO:teuthology.orchestra.run.smithi035.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-01-25T09:39:56.617 INFO:teuthology.orchestra.run.smithi035.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-01-25T09:39:56.617 INFO:teuthology.orchestra.run.smithi035.stdout: "cephfs_mirror_mount_timeout": "10", 2023-01-25T09:39:56.618 INFO:teuthology.orchestra.run.smithi035.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-01-25T09:39:56.618 INFO:teuthology.orchestra.run.smithi035.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-01-25T09:39:56.618 INFO:teuthology.orchestra.run.smithi035.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-01-25T09:39:56.618 INFO:teuthology.orchestra.run.smithi035.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-01-25T09:39:56.618 INFO:teuthology.orchestra.run.smithi035.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-01-25T09:39:56.618 INFO:teuthology.orchestra.run.smithi035.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-01-25T09:39:56.619 INFO:teuthology.orchestra.run.smithi035.stdout: "cephx_cluster_require_signatures": "false", 2023-01-25T09:39:56.619 INFO:teuthology.orchestra.run.smithi035.stdout: "cephx_cluster_require_version": "2", 2023-01-25T09:39:56.619 INFO:teuthology.orchestra.run.smithi035.stdout: "cephx_require_signatures": "false", 2023-01-25T09:39:56.619 INFO:teuthology.orchestra.run.smithi035.stdout: "cephx_require_version": "2", 2023-01-25T09:39:56.619 INFO:teuthology.orchestra.run.smithi035.stdout: "cephx_service_require_signatures": "false", 2023-01-25T09:39:56.620 INFO:teuthology.orchestra.run.smithi035.stdout: "cephx_service_require_version": "2", 2023-01-25T09:39:56.620 INFO:teuthology.orchestra.run.smithi035.stdout: "cephx_sign_messages": "true", 2023-01-25T09:39:56.620 INFO:teuthology.orchestra.run.smithi035.stdout: "chdir": "", 2023-01-25T09:39:56.620 INFO:teuthology.orchestra.run.smithi035.stdout: "client_acl_type": "", 2023-01-25T09:39:56.620 INFO:teuthology.orchestra.run.smithi035.stdout: "client_asio_thread_count": "2", 2023-01-25T09:39:56.621 INFO:teuthology.orchestra.run.smithi035.stdout: "client_cache_mid": "0.750000", 2023-01-25T09:39:56.621 INFO:teuthology.orchestra.run.smithi035.stdout: "client_cache_size": "16384", 2023-01-25T09:39:56.621 INFO:teuthology.orchestra.run.smithi035.stdout: "client_caps_release_delay": "5", 2023-01-25T09:39:56.621 INFO:teuthology.orchestra.run.smithi035.stdout: "client_check_pool_perm": "true", 2023-01-25T09:39:56.621 INFO:teuthology.orchestra.run.smithi035.stdout: "client_collect_and_send_global_metrics": "false", 2023-01-25T09:39:56.622 INFO:teuthology.orchestra.run.smithi035.stdout: "client_debug_force_sync_read": "false", 2023-01-25T09:39:56.622 INFO:teuthology.orchestra.run.smithi035.stdout: "client_debug_getattr_caps": "false", 2023-01-25T09:39:56.622 INFO:teuthology.orchestra.run.smithi035.stdout: "client_debug_inject_tick_delay": "0", 2023-01-25T09:39:56.622 INFO:teuthology.orchestra.run.smithi035.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-01-25T09:39:56.622 INFO:teuthology.orchestra.run.smithi035.stdout: "client_die_on_failed_remount": "false", 2023-01-25T09:39:56.623 INFO:teuthology.orchestra.run.smithi035.stdout: "client_dirsize_rbytes": "true", 2023-01-25T09:39:56.623 INFO:teuthology.orchestra.run.smithi035.stdout: "client_force_lazyio": "false", 2023-01-25T09:39:56.623 INFO:teuthology.orchestra.run.smithi035.stdout: "client_fs": "", 2023-01-25T09:39:56.623 INFO:teuthology.orchestra.run.smithi035.stdout: "client_inject_fixed_oldest_tid": "false", 2023-01-25T09:39:56.624 INFO:teuthology.orchestra.run.smithi035.stdout: "client_inject_release_failure": "false", 2023-01-25T09:39:56.624 INFO:teuthology.orchestra.run.smithi035.stdout: "client_max_inline_size": "4096", 2023-01-25T09:39:56.624 INFO:teuthology.orchestra.run.smithi035.stdout: "client_mds_namespace": "", 2023-01-25T09:39:56.624 INFO:teuthology.orchestra.run.smithi035.stdout: "client_metadata": "", 2023-01-25T09:39:56.624 INFO:teuthology.orchestra.run.smithi035.stdout: "client_mount_gid": "-1", 2023-01-25T09:39:56.625 INFO:teuthology.orchestra.run.smithi035.stdout: "client_mount_timeout": "300", 2023-01-25T09:39:56.625 INFO:teuthology.orchestra.run.smithi035.stdout: "client_mount_uid": "-1", 2023-01-25T09:39:56.625 INFO:teuthology.orchestra.run.smithi035.stdout: "client_mountpoint": "/", 2023-01-25T09:39:56.625 INFO:teuthology.orchestra.run.smithi035.stdout: "client_notify_timeout": "10", 2023-01-25T09:39:56.625 INFO:teuthology.orchestra.run.smithi035.stdout: "client_oc": "true", 2023-01-25T09:39:56.625 INFO:teuthology.orchestra.run.smithi035.stdout: "client_oc_max_dirty": "104857600", 2023-01-25T09:39:56.626 INFO:teuthology.orchestra.run.smithi035.stdout: "client_oc_max_dirty_age": "5.000000", 2023-01-25T09:39:56.626 INFO:teuthology.orchestra.run.smithi035.stdout: "client_oc_max_objects": "1000", 2023-01-25T09:39:56.626 INFO:teuthology.orchestra.run.smithi035.stdout: "client_oc_size": "209715200", 2023-01-25T09:39:56.626 INFO:teuthology.orchestra.run.smithi035.stdout: "client_oc_target_dirty": "8388608", 2023-01-25T09:39:56.626 INFO:teuthology.orchestra.run.smithi035.stdout: "client_permissions": "true", 2023-01-25T09:39:56.627 INFO:teuthology.orchestra.run.smithi035.stdout: "client_quota": "true", 2023-01-25T09:39:56.627 INFO:teuthology.orchestra.run.smithi035.stdout: "client_quota_df": "true", 2023-01-25T09:39:56.627 INFO:teuthology.orchestra.run.smithi035.stdout: "client_readahead_max_bytes": "0", 2023-01-25T09:39:56.627 INFO:teuthology.orchestra.run.smithi035.stdout: "client_readahead_max_periods": "4", 2023-01-25T09:39:56.627 INFO:teuthology.orchestra.run.smithi035.stdout: "client_readahead_min": "131072", 2023-01-25T09:39:56.628 INFO:teuthology.orchestra.run.smithi035.stdout: "client_reconnect_stale": "false", 2023-01-25T09:39:56.628 INFO:teuthology.orchestra.run.smithi035.stdout: "client_shutdown_timeout": "30", 2023-01-25T09:39:56.628 INFO:teuthology.orchestra.run.smithi035.stdout: "client_snapdir": ".snap", 2023-01-25T09:39:56.628 INFO:teuthology.orchestra.run.smithi035.stdout: "client_tick_interval": "1", 2023-01-25T09:39:56.629 INFO:teuthology.orchestra.run.smithi035.stdout: "client_trace": "", 2023-01-25T09:39:56.629 INFO:teuthology.orchestra.run.smithi035.stdout: "client_try_dentry_invalidate": "false", 2023-01-25T09:39:56.629 INFO:teuthology.orchestra.run.smithi035.stdout: "client_use_faked_inos": "false", 2023-01-25T09:39:56.629 INFO:teuthology.orchestra.run.smithi035.stdout: "client_use_random_mds": "false", 2023-01-25T09:39:56.629 INFO:teuthology.orchestra.run.smithi035.stdout: "clog_to_graylog": "false", 2023-01-25T09:39:56.629 INFO:teuthology.orchestra.run.smithi035.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-01-25T09:39:56.630 INFO:teuthology.orchestra.run.smithi035.stdout: "clog_to_graylog_port": "12201", 2023-01-25T09:39:56.630 INFO:teuthology.orchestra.run.smithi035.stdout: "clog_to_monitors": "default=true", 2023-01-25T09:39:56.630 INFO:teuthology.orchestra.run.smithi035.stdout: "clog_to_syslog": "false", 2023-01-25T09:39:56.630 INFO:teuthology.orchestra.run.smithi035.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-01-25T09:39:56.630 INFO:teuthology.orchestra.run.smithi035.stdout: "clog_to_syslog_level": "info", 2023-01-25T09:39:56.631 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_addr": "-", 2023-01-25T09:39:56.631 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_network": "", 2023-01-25T09:39:56.631 INFO:teuthology.orchestra.run.smithi035.stdout: "cluster_network_interface": "", 2023-01-25T09:39:56.631 INFO:teuthology.orchestra.run.smithi035.stdout: "compressor_zlib_isal": "false", 2023-01-25T09:39:56.631 INFO:teuthology.orchestra.run.smithi035.stdout: "compressor_zlib_level": "5", 2023-01-25T09:39:56.632 INFO:teuthology.orchestra.run.smithi035.stdout: "compressor_zlib_winsize": "-15", 2023-01-25T09:39:56.632 INFO:teuthology.orchestra.run.smithi035.stdout: "compressor_zstd_level": "1", 2023-01-25T09:39:56.632 INFO:teuthology.orchestra.run.smithi035.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2023-01-25T09:39:56.632 INFO:teuthology.orchestra.run.smithi035.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-01-25T09:39:56.633 INFO:teuthology.orchestra.run.smithi035.stdout: "crimson_alien_op_num_threads": "6", 2023-01-25T09:39:56.633 INFO:teuthology.orchestra.run.smithi035.stdout: "crimson_alien_thread_cpu_cores": "", 2023-01-25T09:39:56.633 INFO:teuthology.orchestra.run.smithi035.stdout: "crimson_osd_obc_lru_size": "10", 2023-01-25T09:39:56.633 INFO:teuthology.orchestra.run.smithi035.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-01-25T09:39:56.633 INFO:teuthology.orchestra.run.smithi035.stdout: "crimson_seastar_smp": "1", 2023-01-25T09:39:56.634 INFO:teuthology.orchestra.run.smithi035.stdout: "crush_location": "", 2023-01-25T09:39:56.634 INFO:teuthology.orchestra.run.smithi035.stdout: "crush_location_hook": "", 2023-01-25T09:39:56.634 INFO:teuthology.orchestra.run.smithi035.stdout: "crush_location_hook_timeout": "10", 2023-01-25T09:39:56.634 INFO:teuthology.orchestra.run.smithi035.stdout: "daemonize": "false", 2023-01-25T09:39:56.634 INFO:teuthology.orchestra.run.smithi035.stdout: "daos_pool": "tank", 2023-01-25T09:39:56.635 INFO:teuthology.orchestra.run.smithi035.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2023-01-25T09:39:56.635 INFO:teuthology.orchestra.run.smithi035.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2023-01-25T09:39:56.635 INFO:teuthology.orchestra.run.smithi035.stdout: "dbstore_db_name_prefix": "dbstore", 2023-01-25T09:39:56.635 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_alienstore": "0/5", 2023-01-25T09:39:56.635 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_allow_any_pool_priority": "false", 2023-01-25T09:39:56.636 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_asok": "1/5", 2023-01-25T09:39:56.636 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_asok_assert_abort": "false", 2023-01-25T09:39:56.636 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_asserts_on_shutdown": "true", 2023-01-25T09:39:56.636 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_auth": "20/20", 2023-01-25T09:39:56.636 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_bdev": "1/3", 2023-01-25T09:39:56.637 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_bluefs": "1/5", 2023-01-25T09:39:56.637 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_bluestore": "1/5", 2023-01-25T09:39:56.637 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_buffer": "0/1", 2023-01-25T09:39:56.637 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_ceph_exporter": "1/5", 2023-01-25T09:39:56.637 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_cephfs_mirror": "0/5", 2023-01-25T09:39:56.638 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_cephsqlite": "0/5", 2023-01-25T09:39:56.638 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_client": "0/5", 2023-01-25T09:39:56.638 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_compressor": "1/5", 2023-01-25T09:39:56.638 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_context": "0/1", 2023-01-25T09:39:56.638 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_crush": "1/1", 2023-01-25T09:39:56.639 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_crypto": "1/5", 2023-01-25T09:39:56.639 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_cyanstore": "0/5", 2023-01-25T09:39:56.639 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_deliberately_leak_memory": "false", 2023-01-25T09:39:56.639 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_disable_randomized_ping": "false", 2023-01-25T09:39:56.639 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_dpdk": "1/5", 2023-01-25T09:39:56.640 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_eventtrace": "1/5", 2023-01-25T09:39:56.640 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_filer": "0/1", 2023-01-25T09:39:56.640 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_filestore": "1/3", 2023-01-25T09:39:56.640 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_finisher": "1/1", 2023-01-25T09:39:56.640 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_fuse": "1/5", 2023-01-25T09:39:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_heartbeat_testing_span": "0", 2023-01-25T09:39:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_heartbeatmap": "1/5", 2023-01-25T09:39:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_immutable_obj_cache": "0/5", 2023-01-25T09:39:56.641 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_javaclient": "1/5", 2023-01-25T09:39:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_journal": "1/3", 2023-01-25T09:39:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_journaler": "0/5", 2023-01-25T09:39:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_kstore": "1/5", 2023-01-25T09:39:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_leveldb": "4/5", 2023-01-25T09:39:56.642 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_lockdep": "0/1", 2023-01-25T09:39:56.643 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_mclock": "1/5", 2023-01-25T09:39:56.643 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_mds": "1/5", 2023-01-25T09:39:56.643 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_mds_balancer": "1/5", 2023-01-25T09:39:56.643 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_mds_locker": "1/5", 2023-01-25T09:39:56.643 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_mds_log": "1/5", 2023-01-25T09:39:56.644 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_mds_log_expire": "1/5", 2023-01-25T09:39:56.644 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_mds_migrator": "1/5", 2023-01-25T09:39:56.644 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_memstore": "1/5", 2023-01-25T09:39:56.644 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_mgr": "2/5", 2023-01-25T09:39:56.644 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_mgrc": "1/5", 2023-01-25T09:39:56.645 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_mon": "20/20", 2023-01-25T09:39:56.645 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_monc": "0/10", 2023-01-25T09:39:56.645 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_ms": "1/1", 2023-01-25T09:39:56.645 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_none": "0/5", 2023-01-25T09:39:56.645 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_objclass": "0/5", 2023-01-25T09:39:56.646 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_objectcacher": "0/5", 2023-01-25T09:39:56.646 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_objecter": "0/1", 2023-01-25T09:39:56.646 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_optracker": "0/5", 2023-01-25T09:39:56.646 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_osd": "1/5", 2023-01-25T09:39:56.646 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_paxos": "20/20", 2023-01-25T09:39:56.647 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_perfcounter": "1/5", 2023-01-25T09:39:56.647 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_prioritycache": "1/5", 2023-01-25T09:39:56.647 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_rados": "0/5", 2023-01-25T09:39:56.647 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_rbd": "0/5", 2023-01-25T09:39:56.647 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_rbd_mirror": "0/5", 2023-01-25T09:39:56.648 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_rbd_pwl": "0/5", 2023-01-25T09:39:56.648 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_rbd_replay": "0/5", 2023-01-25T09:39:56.648 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_refs": "0/0", 2023-01-25T09:39:56.648 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_reserver": "1/1", 2023-01-25T09:39:56.648 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_rgw": "1/5", 2023-01-25T09:39:56.649 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_rgw_access": "1/5", 2023-01-25T09:39:56.649 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_rgw_datacache": "1/5", 2023-01-25T09:39:56.649 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_rgw_dbstore": "1/5", 2023-01-25T09:39:56.649 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_rgw_flight": "1/5", 2023-01-25T09:39:56.649 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_rgw_sync": "1/5", 2023-01-25T09:39:56.650 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_rocksdb": "4/5", 2023-01-25T09:39:56.650 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore": "0/5", 2023-01-25T09:39:56.650 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_backref": "0/5", 2023-01-25T09:39:56.650 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_cache": "0/5", 2023-01-25T09:39:56.650 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_cleaner": "0/5", 2023-01-25T09:39:56.651 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_device": "0/5", 2023-01-25T09:39:56.651 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_epm": "0/5", 2023-01-25T09:39:56.651 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_fixedkv_tree": "0/5", 2023-01-25T09:39:56.651 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_journal": "0/5", 2023-01-25T09:39:56.651 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_lba": "0/5", 2023-01-25T09:39:56.652 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_odata": "0/5", 2023-01-25T09:39:56.652 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_omap": "0/5", 2023-01-25T09:39:56.652 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_onode": "0/5", 2023-01-25T09:39:56.652 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_t": "0/5", 2023-01-25T09:39:56.653 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_seastore_tm": "0/5", 2023-01-25T09:39:56.653 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_striper": "0/1", 2023-01-25T09:39:56.653 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_test": "0/5", 2023-01-25T09:39:56.653 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_throttle": "1/1", 2023-01-25T09:39:56.653 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_timer": "0/1", 2023-01-25T09:39:56.654 INFO:teuthology.orchestra.run.smithi035.stdout: "debug_tp": "0/5", 2023-01-25T09:39:56.654 INFO:teuthology.orchestra.run.smithi035.stdout: "device_failure_prediction_mode": "none", 2023-01-25T09:39:56.654 INFO:teuthology.orchestra.run.smithi035.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-01-25T09:39:56.654 INFO:teuthology.orchestra.run.smithi035.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2023-01-25T09:39:56.654 INFO:teuthology.orchestra.run.smithi035.stdout: "err_to_graylog": "false", 2023-01-25T09:39:56.655 INFO:teuthology.orchestra.run.smithi035.stdout: "err_to_journald": "false", 2023-01-25T09:39:56.655 INFO:teuthology.orchestra.run.smithi035.stdout: "err_to_stderr": "true", 2023-01-25T09:39:56.655 INFO:teuthology.orchestra.run.smithi035.stdout: "err_to_syslog": "false", 2023-01-25T09:39:56.655 INFO:teuthology.orchestra.run.smithi035.stdout: "event_tracing": "false", 2023-01-25T09:39:56.655 INFO:teuthology.orchestra.run.smithi035.stdout: "exporter_addr": "0.0.0.0", 2023-01-25T09:39:56.656 INFO:teuthology.orchestra.run.smithi035.stdout: "exporter_http_port": "9926", 2023-01-25T09:39:56.656 INFO:teuthology.orchestra.run.smithi035.stdout: "exporter_prio_limit": "5", 2023-01-25T09:39:56.656 INFO:teuthology.orchestra.run.smithi035.stdout: "exporter_sock_dir": "/var/run/ceph/", 2023-01-25T09:39:56.656 INFO:teuthology.orchestra.run.smithi035.stdout: "exporter_sort_metrics": "true", 2023-01-25T09:39:56.656 INFO:teuthology.orchestra.run.smithi035.stdout: "exporter_stats_period": "5", 2023-01-25T09:39:56.657 INFO:teuthology.orchestra.run.smithi035.stdout: "fake_statfs_for_testing": "0", 2023-01-25T09:39:56.657 INFO:teuthology.orchestra.run.smithi035.stdout: "fatal_signal_handlers": "true", 2023-01-25T09:39:56.657 INFO:teuthology.orchestra.run.smithi035.stdout: "filer_max_purge_ops": "10", 2023-01-25T09:39:56.657 INFO:teuthology.orchestra.run.smithi035.stdout: "filer_max_truncate_ops": "128", 2023-01-25T09:39:56.657 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_apply_finisher_threads": "1", 2023-01-25T09:39:56.658 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_blackhole": "false", 2023-01-25T09:39:56.658 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_btrfs_clone_range": "true", 2023-01-25T09:39:56.658 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_btrfs_snap": "true", 2023-01-25T09:39:56.658 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_caller_concurrency": "10", 2023-01-25T09:39:56.658 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_collect_device_partition_information": "true", 2023-01-25T09:39:56.659 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_commit_timeout": "600.000000", 2023-01-25T09:39:56.659 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_debug_inject_read_err": "false", 2023-01-25T09:39:56.659 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_debug_omap_check": "false", 2023-01-25T09:39:56.659 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_debug_random_read_err": "0.000000", 2023-01-25T09:39:56.659 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_debug_verify_split": "false", 2023-01-25T09:39:56.660 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_dump_file": "", 2023-01-25T09:39:56.660 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-01-25T09:39:56.660 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-01-25T09:39:56.660 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_fadvise": "true", 2023-01-25T09:39:56.660 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_fail_eio": "true", 2023-01-25T09:39:56.661 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_fd_cache_shards": "16", 2023-01-25T09:39:56.661 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_fd_cache_size": "128", 2023-01-25T09:39:56.661 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_fiemap": "false", 2023-01-25T09:39:56.661 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_fiemap_threshold": "4096", 2023-01-25T09:39:56.661 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-01-25T09:39:56.661 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_index_retry_probability": "0.000000", 2023-01-25T09:39:56.662 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_inject_stall": "0", 2023-01-25T09:39:56.662 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_journal_parallel": "false", 2023-01-25T09:39:56.662 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_journal_trailing": "false", 2023-01-25T09:39:56.662 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_journal_writeahead": "false", 2023-01-25T09:39:56.662 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_kill_at": "0", 2023-01-25T09:39:56.663 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-01-25T09:39:56.663 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_inline_xattr_size": "0", 2023-01-25T09:39:56.663 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-01-25T09:39:56.663 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-01-25T09:39:56.664 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-01-25T09:39:56.664 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_inline_xattrs": "0", 2023-01-25T09:39:56.664 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-01-25T09:39:56.664 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_inline_xattrs_other": "2", 2023-01-25T09:39:56.664 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-01-25T09:39:56.665 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_sync_interval": "5.000000", 2023-01-25T09:39:56.665 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_xattr_value_size": "0", 2023-01-25T09:39:56.665 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-01-25T09:39:56.665 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-01-25T09:39:56.665 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-01-25T09:39:56.666 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_merge_threshold": "-10", 2023-01-25T09:39:56.666 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_min_sync_interval": "0.010000", 2023-01-25T09:39:56.666 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_odsync_write": "false", 2023-01-25T09:39:56.666 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_omap_backend": "rocksdb", 2023-01-25T09:39:56.666 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_omap_backend_path": "", 2023-01-25T09:39:56.667 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_omap_header_cache_size": "1024", 2023-01-25T09:39:56.667 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_ondisk_finisher_threads": "1", 2023-01-25T09:39:56.667 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-01-25T09:39:56.667 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_op_thread_timeout": "60", 2023-01-25T09:39:56.667 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_op_threads": "2", 2023-01-25T09:39:56.667 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_punch_hole": "false", 2023-01-25T09:39:56.668 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-01-25T09:39:56.668 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-01-25T09:39:56.668 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-01-25T09:39:56.668 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-01-25T09:39:56.669 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-01-25T09:39:56.669 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_queue_max_bytes": "104857600", 2023-01-25T09:39:56.669 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-01-25T09:39:56.669 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-01-25T09:39:56.669 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-01-25T09:39:56.670 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_queue_max_ops": "50", 2023-01-25T09:39:56.670 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-01-25T09:39:56.670 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_seek_data_hole": "false", 2023-01-25T09:39:56.670 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_sloppy_crc": "false", 2023-01-25T09:39:56.671 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-01-25T09:39:56.671 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_splice": "false", 2023-01-25T09:39:56.671 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_split_multiple": "2", 2023-01-25T09:39:56.671 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_split_rand_factor": "20", 2023-01-25T09:39:56.671 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_update_to": "1000", 2023-01-25T09:39:56.672 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-01-25T09:39:56.672 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-01-25T09:39:56.672 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-01-25T09:39:56.672 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-01-25T09:39:56.673 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-01-25T09:39:56.673 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-01-25T09:39:56.673 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_enable": "true", 2023-01-25T09:39:56.673 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-01-25T09:39:56.673 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-01-25T09:39:56.673 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-01-25T09:39:56.674 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-01-25T09:39:56.674 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-01-25T09:39:56.674 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-01-25T09:39:56.674 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_xfs_extsize": "false", 2023-01-25T09:39:56.674 INFO:teuthology.orchestra.run.smithi035.stdout: "filestore_zfs_snap": "false", 2023-01-25T09:39:56.675 INFO:teuthology.orchestra.run.smithi035.stdout: "fio_dir": "/tmp/fio", 2023-01-25T09:39:56.675 INFO:teuthology.orchestra.run.smithi035.stdout: "fsid": "97131e4b-ba28-4ab8-a3d7-d027cd4303dd", 2023-01-25T09:39:56.675 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_allow_other": "true", 2023-01-25T09:39:56.675 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_atomic_o_trunc": "true", 2023-01-25T09:39:56.675 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_big_writes": "true", 2023-01-25T09:39:56.676 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_debug": "false", 2023-01-25T09:39:56.676 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_default_permissions": "false", 2023-01-25T09:39:56.676 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_disable_pagecache": "false", 2023-01-25T09:39:56.676 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_max_write": "0", 2023-01-25T09:39:56.676 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_multithreaded": "true", 2023-01-25T09:39:56.677 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_require_active_mds": "true", 2023-01-25T09:39:56.677 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_set_user_groups": "true", 2023-01-25T09:39:56.677 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_splice_move": "true", 2023-01-25T09:39:56.677 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_splice_read": "true", 2023-01-25T09:39:56.678 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_splice_write": "true", 2023-01-25T09:39:56.678 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_syncfs_on_mksnap": "true", 2023-01-25T09:39:56.678 INFO:teuthology.orchestra.run.smithi035.stdout: "fuse_use_invalidate_cb": "true", 2023-01-25T09:39:56.678 INFO:teuthology.orchestra.run.smithi035.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-01-25T09:39:56.678 INFO:teuthology.orchestra.run.smithi035.stdout: "gss_target_name": "ceph", 2023-01-25T09:39:56.678 INFO:teuthology.orchestra.run.smithi035.stdout: "heartbeat_file": "", 2023-01-25T09:39:56.679 INFO:teuthology.orchestra.run.smithi035.stdout: "heartbeat_inject_failure": "0", 2023-01-25T09:39:56.679 INFO:teuthology.orchestra.run.smithi035.stdout: "heartbeat_interval": "5", 2023-01-25T09:39:56.679 INFO:teuthology.orchestra.run.smithi035.stdout: "host": "smithi035", 2023-01-25T09:39:56.679 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-01-25T09:39:56.679 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-01-25T09:39:56.680 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_max_size": "1073741824", 2023-01-25T09:39:56.680 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-01-25T09:39:56.680 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-01-25T09:39:56.680 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-01-25T09:39:56.680 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-01-25T09:39:56.681 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-01-25T09:39:56.681 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-01-25T09:39:56.681 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-01-25T09:39:56.681 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-01-25T09:39:56.681 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-01-25T09:39:56.682 INFO:teuthology.orchestra.run.smithi035.stdout: "immutable_object_cache_watermark": "0.900000", 2023-01-25T09:39:56.682 INFO:teuthology.orchestra.run.smithi035.stdout: "inject_early_sigterm": "false", 2023-01-25T09:39:56.682 INFO:teuthology.orchestra.run.smithi035.stdout: "jaeger_tracing_enable": "false", 2023-01-25T09:39:56.682 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_aio": "true", 2023-01-25T09:39:56.682 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_align_min_size": "65536", 2023-01-25T09:39:56.683 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_block_align": "true", 2023-01-25T09:39:56.683 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_block_size": "4096", 2023-01-25T09:39:56.683 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_dio": "true", 2023-01-25T09:39:56.683 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_discard": "false", 2023-01-25T09:39:56.683 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_force_aio": "false", 2023-01-25T09:39:56.683 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_ignore_corruption": "false", 2023-01-25T09:39:56.684 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_max_write_bytes": "10485760", 2023-01-25T09:39:56.684 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_max_write_entries": "100", 2023-01-25T09:39:56.684 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_replay_from": "0", 2023-01-25T09:39:56.684 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_throttle_high_multiple": "0.000000", 2023-01-25T09:39:56.684 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-01-25T09:39:56.685 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-01-25T09:39:56.685 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_throttle_max_multiple": "0.000000", 2023-01-25T09:39:56.685 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_write_header_frequency": "0", 2023-01-25T09:39:56.685 INFO:teuthology.orchestra.run.smithi035.stdout: "journal_zero_on_create": "false", 2023-01-25T09:39:56.685 INFO:teuthology.orchestra.run.smithi035.stdout: "journaler_prefetch_periods": "10", 2023-01-25T09:39:56.686 INFO:teuthology.orchestra.run.smithi035.stdout: "journaler_prezero_periods": "5", 2023-01-25T09:39:56.686 INFO:teuthology.orchestra.run.smithi035.stdout: "journaler_write_head_interval": "15", 2023-01-25T09:39:56.686 INFO:teuthology.orchestra.run.smithi035.stdout: "key": "", 2023-01-25T09:39:56.686 INFO:teuthology.orchestra.run.smithi035.stdout: "keyfile": "", 2023-01-25T09:39:56.686 INFO:teuthology.orchestra.run.smithi035.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-01-25T09:39:56.687 INFO:teuthology.orchestra.run.smithi035.stdout: "kstore_backend": "rocksdb", 2023-01-25T09:39:56.687 INFO:teuthology.orchestra.run.smithi035.stdout: "kstore_default_stripe_size": "65536", 2023-01-25T09:39:56.687 INFO:teuthology.orchestra.run.smithi035.stdout: "kstore_fsck_on_mount": "false", 2023-01-25T09:39:56.687 INFO:teuthology.orchestra.run.smithi035.stdout: "kstore_fsck_on_mount_deep": "true", 2023-01-25T09:39:56.687 INFO:teuthology.orchestra.run.smithi035.stdout: "kstore_max_bytes": "67108864", 2023-01-25T09:39:56.688 INFO:teuthology.orchestra.run.smithi035.stdout: "kstore_max_ops": "512", 2023-01-25T09:39:56.688 INFO:teuthology.orchestra.run.smithi035.stdout: "kstore_nid_prealloc": "1024", 2023-01-25T09:39:56.688 INFO:teuthology.orchestra.run.smithi035.stdout: "kstore_onode_map_size": "1024", 2023-01-25T09:39:56.688 INFO:teuthology.orchestra.run.smithi035.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-01-25T09:39:56.688 INFO:teuthology.orchestra.run.smithi035.stdout: "kstore_sync_submit_transaction": "false", 2023-01-25T09:39:56.689 INFO:teuthology.orchestra.run.smithi035.stdout: "kstore_sync_transaction": "false", 2023-01-25T09:39:56.689 INFO:teuthology.orchestra.run.smithi035.stdout: "leveldb_block_size": "65536", 2023-01-25T09:39:56.689 INFO:teuthology.orchestra.run.smithi035.stdout: "leveldb_bloom_size": "0", 2023-01-25T09:39:56.689 INFO:teuthology.orchestra.run.smithi035.stdout: "leveldb_cache_size": "536870912", 2023-01-25T09:39:56.690 INFO:teuthology.orchestra.run.smithi035.stdout: "leveldb_compact_on_mount": "false", 2023-01-25T09:39:56.690 INFO:teuthology.orchestra.run.smithi035.stdout: "leveldb_compression": "false", 2023-01-25T09:39:56.690 INFO:teuthology.orchestra.run.smithi035.stdout: "leveldb_log": "", 2023-01-25T09:39:56.690 INFO:teuthology.orchestra.run.smithi035.stdout: "leveldb_log_to_ceph_log": "true", 2023-01-25T09:39:56.690 INFO:teuthology.orchestra.run.smithi035.stdout: "leveldb_max_open_files": "0", 2023-01-25T09:39:56.691 INFO:teuthology.orchestra.run.smithi035.stdout: "leveldb_paranoid": "false", 2023-01-25T09:39:56.691 INFO:teuthology.orchestra.run.smithi035.stdout: "leveldb_write_buffer_size": "33554432", 2023-01-25T09:39:56.691 INFO:teuthology.orchestra.run.smithi035.stdout: "librados_thread_count": "2", 2023-01-25T09:39:56.691 INFO:teuthology.orchestra.run.smithi035.stdout: "lockdep": "false", 2023-01-25T09:39:56.691 INFO:teuthology.orchestra.run.smithi035.stdout: "lockdep_force_backtrace": "false", 2023-01-25T09:39:56.691 INFO:teuthology.orchestra.run.smithi035.stdout: "log_coarse_timestamps": "true", 2023-01-25T09:39:56.692 INFO:teuthology.orchestra.run.smithi035.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-01-25T09:39:56.692 INFO:teuthology.orchestra.run.smithi035.stdout: "log_flush_on_exit": "false", 2023-01-25T09:39:56.692 INFO:teuthology.orchestra.run.smithi035.stdout: "log_graylog_host": "127.0.0.1", 2023-01-25T09:39:56.692 INFO:teuthology.orchestra.run.smithi035.stdout: "log_graylog_port": "12201", 2023-01-25T09:39:56.693 INFO:teuthology.orchestra.run.smithi035.stdout: "log_max_new": "1000", 2023-01-25T09:39:56.693 INFO:teuthology.orchestra.run.smithi035.stdout: "log_max_recent": "10000", 2023-01-25T09:39:56.693 INFO:teuthology.orchestra.run.smithi035.stdout: "log_stderr_prefix": "", 2023-01-25T09:39:56.693 INFO:teuthology.orchestra.run.smithi035.stdout: "log_stop_at_utilization": "0.970000", 2023-01-25T09:39:56.693 INFO:teuthology.orchestra.run.smithi035.stdout: "log_to_file": "true", 2023-01-25T09:39:56.694 INFO:teuthology.orchestra.run.smithi035.stdout: "log_to_graylog": "false", 2023-01-25T09:39:56.694 INFO:teuthology.orchestra.run.smithi035.stdout: "log_to_journald": "false", 2023-01-25T09:39:56.694 INFO:teuthology.orchestra.run.smithi035.stdout: "log_to_stderr": "false", 2023-01-25T09:39:56.694 INFO:teuthology.orchestra.run.smithi035.stdout: "log_to_syslog": "false", 2023-01-25T09:39:56.694 INFO:teuthology.orchestra.run.smithi035.stdout: "max_rotating_auth_attempts": "10", 2023-01-25T09:39:56.695 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_action_on_write_error": "1", 2023-01-25T09:39:56.695 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_alternate_name_max": "8192", 2023-01-25T09:39:56.695 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_asio_thread_count": "2", 2023-01-25T09:39:56.695 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_export_pin": "true", 2023-01-25T09:39:56.695 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_fragment_dirs": "true", 2023-01-25T09:39:56.695 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-01-25T09:39:56.696 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_fragment_interval": "5", 2023-01-25T09:39:56.696 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_fragment_size_max": "100000", 2023-01-25T09:39:56.696 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_idle_threshold": "0.000000", 2023-01-25T09:39:56.696 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_interval": "10", 2023-01-25T09:39:56.696 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_max": "-1", 2023-01-25T09:39:56.697 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_max_until": "-1", 2023-01-25T09:39:56.697 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_merge_size": "50", 2023-01-25T09:39:56.697 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_midchunk": "0.300000", 2023-01-25T09:39:56.697 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_min_rebalance": "0.100000", 2023-01-25T09:39:56.697 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_min_start": "0.200000", 2023-01-25T09:39:56.697 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_minchunk": "0.001000", 2023-01-25T09:39:56.698 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_mode": "0", 2023-01-25T09:39:56.698 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_need_max": "1.200000", 2023-01-25T09:39:56.698 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_need_min": "0.800000", 2023-01-25T09:39:56.698 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-01-25T09:39:56.698 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_sample_interval": "3.000000", 2023-01-25T09:39:56.699 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_split_bits": "3", 2023-01-25T09:39:56.699 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_split_rd": "25000.000000", 2023-01-25T09:39:56.699 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_split_size": "10000", 2023-01-25T09:39:56.699 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_split_wr": "10000.000000", 2023-01-25T09:39:56.699 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_target_decay": "10.000000", 2023-01-25T09:39:56.700 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-01-25T09:39:56.700 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_beacon_grace": "15.000000", 2023-01-25T09:39:56.700 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_beacon_interval": "4.000000", 2023-01-25T09:39:56.700 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_beacon_mon_down_grace": "60", 2023-01-25T09:39:56.700 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_cache_memory_limit": "4294967296", 2023-01-25T09:39:56.701 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_cache_mid": "0.700000", 2023-01-25T09:39:56.701 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_cache_release_free_interval": "10", 2023-01-25T09:39:56.701 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_cache_reservation": "0.050000", 2023-01-25T09:39:56.701 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-01-25T09:39:56.701 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_cache_trim_interval": "1", 2023-01-25T09:39:56.701 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_cache_trim_threshold": "262144", 2023-01-25T09:39:56.702 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-01-25T09:39:56.702 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-01-25T09:39:56.702 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_client_delegate_inos_pct": "50", 2023-01-25T09:39:56.702 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_client_prealloc_inos": "1000", 2023-01-25T09:39:56.702 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-01-25T09:39:56.703 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_connect_bootstrapping": "false", 2023-01-25T09:39:56.703 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_damage_table_max_entries": "10000", 2023-01-25T09:39:56.703 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-01-25T09:39:56.703 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_debug_auth_pins": "false", 2023-01-25T09:39:56.703 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_debug_frag": "false", 2023-01-25T09:39:56.703 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_debug_scatterstat": "false", 2023-01-25T09:39:56.704 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_debug_subtrees": "false", 2023-01-25T09:39:56.704 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_decay_halflife": "5.000000", 2023-01-25T09:39:56.704 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_default_dir_hash": "2", 2023-01-25T09:39:56.704 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_defer_session_stale": "true", 2023-01-25T09:39:56.704 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_deny_all_reconnect": "false", 2023-01-25T09:39:56.705 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_dir_keys_per_op": "16384", 2023-01-25T09:39:56.705 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_dir_max_commit_size": "10", 2023-01-25T09:39:56.705 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_dir_max_entries": "0", 2023-01-25T09:39:56.705 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_dir_prefetch": "true", 2023-01-25T09:39:56.705 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_dirstat_min_interval": "1.000000", 2023-01-25T09:39:56.706 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_dump_cache_after_rejoin": "false", 2023-01-25T09:39:56.706 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_dump_cache_on_map": "false", 2023-01-25T09:39:56.706 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_dump_cache_threshold_file": "0", 2023-01-25T09:39:56.706 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-01-25T09:39:56.706 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_early_reply": "true", 2023-01-25T09:39:56.706 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_enable_op_tracker": "true", 2023-01-25T09:39:56.707 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_enforce_unique_name": "true", 2023-01-25T09:39:56.707 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_export_ephemeral_distributed": "true", 2023-01-25T09:39:56.707 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-01-25T09:39:56.707 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_export_ephemeral_random": "true", 2023-01-25T09:39:56.707 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-01-25T09:39:56.708 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_extraordinary_events_dump_interval": "0", 2023-01-25T09:39:56.708 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_forward_all_requests_to_auth": "false", 2023-01-25T09:39:56.708 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-01-25T09:39:56.708 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_fscrypt_last_block_max_size": "4096", 2023-01-25T09:39:56.708 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-01-25T09:39:56.709 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_health_cache_threshold": "1.500000", 2023-01-25T09:39:56.709 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_health_summarize_threshold": "10", 2023-01-25T09:39:56.709 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_heartbeat_grace": "15.000000", 2023-01-25T09:39:56.709 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_heartbeat_reset_grace": "1000", 2023-01-25T09:39:56.709 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_inject_health_dummy": "false", 2023-01-25T09:39:56.709 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_inject_migrator_session_race": "false", 2023-01-25T09:39:56.710 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-01-25T09:39:56.710 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_join_fs": "", 2023-01-25T09:39:56.710 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_journal_format": "1", 2023-01-25T09:39:56.710 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_kill_create_at": "0", 2023-01-25T09:39:56.710 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_kill_export_at": "0", 2023-01-25T09:39:56.711 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_kill_import_at": "0", 2023-01-25T09:39:56.711 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_kill_journal_at": "0", 2023-01-25T09:39:56.711 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_kill_journal_expire_at": "0", 2023-01-25T09:39:56.711 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_kill_journal_replay_at": "0", 2023-01-25T09:39:56.712 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_kill_link_at": "0", 2023-01-25T09:39:56.712 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_kill_mdstable_at": "0", 2023-01-25T09:39:56.712 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_kill_openc_at": "0", 2023-01-25T09:39:56.712 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_kill_rename_at": "0", 2023-01-25T09:39:56.712 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_log_events_per_segment": "1024", 2023-01-25T09:39:56.713 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_log_max_events": "-1", 2023-01-25T09:39:56.713 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_log_max_segments": "128", 2023-01-25T09:39:56.713 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_log_pause": "false", 2023-01-25T09:39:56.713 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_log_segment_size": "0", 2023-01-25T09:39:56.713 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_log_skip_corrupt_events": "false", 2023-01-25T09:39:56.713 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_log_warn_factor": "2.000000", 2023-01-25T09:39:56.714 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_max_caps_per_client": "1048576", 2023-01-25T09:39:56.714 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_max_completed_flushes": "100000", 2023-01-25T09:39:56.714 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_max_completed_requests": "100000", 2023-01-25T09:39:56.714 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_max_export_size": "20971520", 2023-01-25T09:39:56.714 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_max_file_recover": "32", 2023-01-25T09:39:56.715 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_max_purge_files": "64", 2023-01-25T09:39:56.715 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_max_purge_ops": "8192", 2023-01-25T09:39:56.715 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-01-25T09:39:56.715 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_max_retries_on_remount_failure": "5", 2023-01-25T09:39:56.715 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-01-25T09:39:56.715 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_max_snaps_per_dir": "100", 2023-01-25T09:39:56.716 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_max_xattr_pairs_size": "65536", 2023-01-25T09:39:56.716 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_metrics_update_interval": "2", 2023-01-25T09:39:56.716 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_min_caps_per_client": "100", 2023-01-25T09:39:56.716 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_min_caps_working_set": "10000", 2023-01-25T09:39:56.716 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-01-25T09:39:56.717 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_numa_node": "-1", 2023-01-25T09:39:56.717 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-01-25T09:39:56.717 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_op_complaint_time": "30.000000", 2023-01-25T09:39:56.717 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_op_history_duration": "600", 2023-01-25T09:39:56.717 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_op_history_size": "20", 2023-01-25T09:39:56.718 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_op_log_threshold": "5", 2023-01-25T09:39:56.718 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_ping_grace": "15", 2023-01-25T09:39:56.718 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_ping_interval": "5", 2023-01-25T09:39:56.718 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-01-25T09:39:56.718 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-01-25T09:39:56.718 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_recall_max_caps": "30000", 2023-01-25T09:39:56.719 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-01-25T09:39:56.719 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_recall_max_decay_threshold": "131072", 2023-01-25T09:39:56.719 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-01-25T09:39:56.719 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_recall_warning_threshold": "262144", 2023-01-25T09:39:56.719 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_reconnect_timeout": "45.000000", 2023-01-25T09:39:56.720 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_replay_interval": "1.000000", 2023-01-25T09:39:56.720 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-01-25T09:39:56.720 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-01-25T09:39:56.720 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_root_ino_gid": "0", 2023-01-25T09:39:56.720 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_root_ino_uid": "0", 2023-01-25T09:39:56.721 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-01-25T09:39:56.721 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_session_blocklist_on_evict": "true", 2023-01-25T09:39:56.721 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_session_blocklist_on_timeout": "true", 2023-01-25T09:39:56.721 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-01-25T09:39:56.721 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-01-25T09:39:56.722 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_session_cap_acquisition_decay_rate": "10.000000", 2023-01-25T09:39:56.722 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_session_cap_acquisition_throttle": "500000", 2023-01-25T09:39:56.722 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-01-25T09:39:56.722 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-01-25T09:39:56.722 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_shutdown_check": "0", 2023-01-25T09:39:56.723 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_skip_ino": "0", 2023-01-25T09:39:56.723 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_sleep_rank_change": "0.000000", 2023-01-25T09:39:56.723 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_snap_max_uid": "4294967294", 2023-01-25T09:39:56.723 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_snap_min_uid": "0", 2023-01-25T09:39:56.723 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_snap_rstat": "false", 2023-01-25T09:39:56.724 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_standby_replay_damaged": "false", 2023-01-25T09:39:56.724 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_symlink_recovery": "true", 2023-01-25T09:39:56.724 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_task_status_update_interval": "2.000000", 2023-01-25T09:39:56.724 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_thrash_exports": "0", 2023-01-25T09:39:56.724 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_thrash_fragments": "0", 2023-01-25T09:39:56.725 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_tick_interval": "5.000000", 2023-01-25T09:39:56.725 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_valgrind_exit": "false", 2023-01-25T09:39:56.725 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_verify_backtrace": "1", 2023-01-25T09:39:56.725 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_verify_scatter": "false", 2023-01-25T09:39:56.725 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_wipe_ino_prealloc": "false", 2023-01-25T09:39:56.726 INFO:teuthology.orchestra.run.smithi035.stdout: "mds_wipe_sessions": "false", 2023-01-25T09:39:56.726 INFO:teuthology.orchestra.run.smithi035.stdout: "mempool_debug": "false", 2023-01-25T09:39:56.726 INFO:teuthology.orchestra.run.smithi035.stdout: "memstore_debug_omit_block_device_write": "false", 2023-01-25T09:39:56.726 INFO:teuthology.orchestra.run.smithi035.stdout: "memstore_device_bytes": "1073741824", 2023-01-25T09:39:56.726 INFO:teuthology.orchestra.run.smithi035.stdout: "memstore_page_set": "false", 2023-01-25T09:39:56.726 INFO:teuthology.orchestra.run.smithi035.stdout: "memstore_page_size": "65536", 2023-01-25T09:39:56.727 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_client_bytes": "134217728", 2023-01-25T09:39:56.727 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_client_messages": "512", 2023-01-25T09:39:56.727 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-01-25T09:39:56.727 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_connect_retry_interval": "1.000000", 2023-01-25T09:39:56.727 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-01-25T09:39:56.728 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-01-25T09:39:56.728 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_disabled_modules": "", 2023-01-25T09:39:56.728 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-01-25T09:39:56.728 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_max_pg_num_change": "128", 2023-01-25T09:39:56.728 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_mds_bytes": "134217728", 2023-01-25T09:39:56.729 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_mds_messages": "128", 2023-01-25T09:39:56.729 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-01-25T09:39:56.729 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_mon_bytes": "134217728", 2023-01-25T09:39:56.729 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_mon_messages": "128", 2023-01-25T09:39:56.730 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_osd_bytes": "536870912", 2023-01-25T09:39:56.730 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_osd_messages": "8192", 2023-01-25T09:39:56.730 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_pool": "true", 2023-01-25T09:39:56.730 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_service_beacon_grace": "60.000000", 2023-01-25T09:39:56.730 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_standby_modules": "true", 2023-01-25T09:39:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_stats_period": "5", 2023-01-25T09:39:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_stats_threshold": "5", 2023-01-25T09:39:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_tick_period": "2", 2023-01-25T09:39:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-01-25T09:39:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_accept_timeout_factor": "2.000000", 2023-01-25T09:39:56.731 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_allow_pool_delete": "true", 2023-01-25T09:39:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_allow_pool_size_one": "true", 2023-01-25T09:39:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_auth_validate_all_caps": "true", 2023-01-25T09:39:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-01-25T09:39:56.732 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-01-25T09:39:56.733 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_client_bytes": "104857600", 2023-01-25T09:39:56.733 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_client_directed_command_retry": "5", 2023-01-25T09:39:56.733 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_client_hunt_interval": "3.000000", 2023-01-25T09:39:56.733 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-01-25T09:39:56.733 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-01-25T09:39:56.734 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-01-25T09:39:56.734 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_client_hunt_parallel": "3", 2023-01-25T09:39:56.734 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_client_log_interval": "1.000000", 2023-01-25T09:39:56.734 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-01-25T09:39:56.734 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_client_ping_interval": "10.000000", 2023-01-25T09:39:56.735 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_client_ping_timeout": "30.000000", 2023-01-25T09:39:56.735 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_clock_drift_allowed": "1.000000", 2023-01-25T09:39:56.735 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-01-25T09:39:56.735 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-01-25T09:39:56.735 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cluster_log_file_level": "debug", 2023-01-25T09:39:56.735 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cluster_log_to_file": "true", 2023-01-25T09:39:56.736 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cluster_log_to_graylog": "false", 2023-01-25T09:39:56.736 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-01-25T09:39:56.736 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-01-25T09:39:56.736 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cluster_log_to_journald": "false", 2023-01-25T09:39:56.736 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cluster_log_to_stderr": "false", 2023-01-25T09:39:56.737 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-01-25T09:39:56.737 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-01-25T09:39:56.737 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-01-25T09:39:56.737 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_compact_on_bootstrap": "false", 2023-01-25T09:39:56.737 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_compact_on_start": "false", 2023-01-25T09:39:56.738 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_compact_on_trim": "true", 2023-01-25T09:39:56.738 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_con_tracker_persist_interval": "10", 2023-01-25T09:39:56.738 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_con_tracker_score_halflife": "43200", 2023-01-25T09:39:56.738 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_config_key_max_entry_size": "65536", 2023-01-25T09:39:56.738 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_cpu_threads": "4", 2023-01-25T09:39:56.739 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_crush_min_required_version": "hammer", 2023-01-25T09:39:56.739 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_daemon_bytes": "419430400", 2023-01-25T09:39:56.739 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-01-25T09:39:56.739 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_data_avail_crit": "5", 2023-01-25T09:39:56.739 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_data_avail_warn": "5", 2023-01-25T09:39:56.740 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_data_size_warn": "16106127360", 2023-01-25T09:39:56.740 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_debug_block_osdmap_trim": "false", 2023-01-25T09:39:56.740 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-01-25T09:39:56.740 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_debug_dump_json": "false", 2023-01-25T09:39:56.740 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-01-25T09:39:56.741 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_debug_dump_transactions": "false", 2023-01-25T09:39:56.741 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_debug_extra_checks": "false", 2023-01-25T09:39:56.741 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-01-25T09:39:56.741 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-01-25T09:39:56.741 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_debug_no_require_quincy": "false", 2023-01-25T09:39:56.742 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_debug_no_require_reef": "false", 2023-01-25T09:39:56.742 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-01-25T09:39:56.742 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_delta_reset_interval": "10.000000", 2023-01-25T09:39:56.742 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_dns_srv_name": "ceph-mon", 2023-01-25T09:39:56.742 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_down_mkfs_grace": "120", 2023-01-25T09:39:56.743 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_election_default_strategy": "3", 2023-01-25T09:39:56.743 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_election_timeout": "5.000000", 2023-01-25T09:39:56.743 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-01-25T09:39:56.743 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_elector_ping_divisor": "2", 2023-01-25T09:39:56.743 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_elector_ping_timeout": "2.000000", 2023-01-25T09:39:56.744 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_enable_op_tracker": "true", 2023-01-25T09:39:56.744 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_fake_pool_delete": "false", 2023-01-25T09:39:56.744 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_force_quorum_join": "false", 2023-01-25T09:39:56.744 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_globalid_prealloc": "10000", 2023-01-25T09:39:56.744 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_health_detail_to_clog": "false", 2023-01-25T09:39:56.744 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_health_log_update_period": "5", 2023-01-25T09:39:56.745 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_health_max_detail": "50", 2023-01-25T09:39:56.745 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_health_to_clog": "true", 2023-01-25T09:39:56.745 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_health_to_clog_interval": "600", 2023-01-25T09:39:56.745 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-01-25T09:39:56.745 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_host": "[v1:172.21.15.35:6789],[v1:172.21.15.35:6790],[v1:172.21.15.138:6789]", 2023-01-25T09:39:56.746 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_host_override": "", 2023-01-25T09:39:56.746 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_initial_members": "", 2023-01-25T09:39:56.746 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-01-25T09:39:56.746 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-01-25T09:39:56.746 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-01-25T09:39:56.747 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-01-25T09:39:56.747 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_keyvaluedb": "rocksdb", 2023-01-25T09:39:56.747 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_lease": "5.000000", 2023-01-25T09:39:56.747 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-01-25T09:39:56.747 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-01-25T09:39:56.748 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_log_full_interval": "50", 2023-01-25T09:39:56.748 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_log_max": "10000", 2023-01-25T09:39:56.748 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_log_max_summary": "50", 2023-01-25T09:39:56.748 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_max_log_entries_per_event": "4096", 2023-01-25T09:39:56.748 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_max_log_epochs": "500", 2023-01-25T09:39:56.749 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_max_mdsmap_epochs": "500", 2023-01-25T09:39:56.749 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_max_mgrmap_epochs": "500", 2023-01-25T09:39:56.749 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_max_osd": "10000", 2023-01-25T09:39:56.749 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_max_pg_per_osd": "10000", 2023-01-25T09:39:56.749 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_max_pool_pg_num": "65536", 2023-01-25T09:39:56.749 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-01-25T09:39:56.750 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-01-25T09:39:56.750 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_mds_force_trim_to": "0", 2023-01-25T09:39:56.750 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_mds_skip_sanity": "false", 2023-01-25T09:39:56.750 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_memory_autotune": "true", 2023-01-25T09:39:56.750 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_memory_target": "2147483648", 2023-01-25T09:39:56.750 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_mgr_beacon_grace": "30", 2023-01-25T09:39:56.751 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-01-25T09:39:56.751 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_mgr_digest_period": "5", 2023-01-25T09:39:56.751 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_mgr_inactive_grace": "60", 2023-01-25T09:39:56.751 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_mgr_mkfs_grace": "240", 2023-01-25T09:39:56.751 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-01-25T09:39:56.752 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_min_osdmap_epochs": "500", 2023-01-25T09:39:56.752 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_op_complaint_time": "30", 2023-01-25T09:39:56.752 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_op_history_duration": "600", 2023-01-25T09:39:56.752 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_op_history_size": "20", 2023-01-25T09:39:56.752 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_op_history_slow_op_size": "20", 2023-01-25T09:39:56.753 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_op_history_slow_op_threshold": "10", 2023-01-25T09:39:56.753 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_op_log_threshold": "5", 2023-01-25T09:39:56.753 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-01-25T09:39:56.753 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-01-25T09:39:56.753 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-01-25T09:39:56.754 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_auto_mark_in": "false", 2023-01-25T09:39:56.754 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_auto_mark_new_in": "true", 2023-01-25T09:39:56.754 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-01-25T09:39:56.754 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-01-25T09:39:56.754 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_cache_size": "500", 2023-01-25T09:39:56.755 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_cache_size_min": "134217728", 2023-01-25T09:39:56.755 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_crush_smoke_test": "true", 2023-01-25T09:39:56.755 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_destroyed_out_interval": "600", 2023-01-25T09:39:56.755 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_down_out_interval": "600", 2023-01-25T09:39:56.755 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-01-25T09:39:56.756 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-01-25T09:39:56.756 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_force_trim_to": "0", 2023-01-25T09:39:56.756 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_full_ratio": "0.950000", 2023-01-25T09:39:56.756 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-01-25T09:39:56.757 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_laggy_halflife": "3600", 2023-01-25T09:39:56.757 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_laggy_max_interval": "300", 2023-01-25T09:39:56.757 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_laggy_weight": "0.300000", 2023-01-25T09:39:56.757 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-01-25T09:39:56.757 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_max_creating_pgs": "1024", 2023-01-25T09:39:56.758 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_max_initial_pgs": "1024", 2023-01-25T09:39:56.758 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_min_down_reporters": "2", 2023-01-25T09:39:56.758 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-01-25T09:39:56.758 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-01-25T09:39:56.758 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-01-25T09:39:56.759 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_prime_pg_temp": "true", 2023-01-25T09:39:56.759 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-01-25T09:39:56.759 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-01-25T09:39:56.759 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_report_timeout": "900", 2023-01-25T09:39:56.759 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-01-25T09:39:56.760 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-01-25T09:39:56.760 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_warn_num_repaired": "10", 2023-01-25T09:39:56.760 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osd_warn_op_age": "32.000000", 2023-01-25T09:39:56.760 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-01-25T09:39:56.760 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osdmap_full_prune_interval": "10", 2023-01-25T09:39:56.761 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osdmap_full_prune_min": "10000", 2023-01-25T09:39:56.761 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_osdmap_full_prune_txsize": "100", 2023-01-25T09:39:56.761 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-01-25T09:39:56.761 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_pg_stuck_threshold": "60", 2023-01-25T09:39:56.761 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-01-25T09:39:56.762 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_pg_warn_min_objects": "10000", 2023-01-25T09:39:56.762 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_pg_warn_min_per_osd": "0", 2023-01-25T09:39:56.762 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-01-25T09:39:56.762 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_pool_quota_crit_threshold": "0", 2023-01-25T09:39:56.762 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_pool_quota_warn_threshold": "0", 2023-01-25T09:39:56.763 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_probe_timeout": "2.000000", 2023-01-25T09:39:56.763 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_reweight_max_change": "0.050000", 2023-01-25T09:39:56.763 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_reweight_max_osds": "4", 2023-01-25T09:39:56.763 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-01-25T09:39:56.763 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-01-25T09:39:56.763 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-01-25T09:39:56.764 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-01-25T09:39:56.764 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-01-25T09:39:56.764 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_scrub_interval": "300", 2023-01-25T09:39:56.764 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_scrub_max_keys": "100", 2023-01-25T09:39:56.765 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_scrub_timeout": "300", 2023-01-25T09:39:56.765 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_session_timeout": "300", 2023-01-25T09:39:56.765 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_smart_report_timeout": "5", 2023-01-25T09:39:56.765 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_stat_smooth_intervals": "6", 2023-01-25T09:39:56.765 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-01-25T09:39:56.766 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_stretch_pool_min_size": "2", 2023-01-25T09:39:56.766 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_stretch_pool_size": "4", 2023-01-25T09:39:56.766 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-01-25T09:39:56.766 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_subscribe_interval": "86400.000000", 2023-01-25T09:39:56.766 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_sync_debug": "false", 2023-01-25T09:39:56.767 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_sync_max_payload_keys": "2000", 2023-01-25T09:39:56.767 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_sync_max_payload_size": "1048576", 2023-01-25T09:39:56.767 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_sync_provider_kill_at": "0", 2023-01-25T09:39:56.767 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_sync_requester_kill_at": "0", 2023-01-25T09:39:56.767 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_sync_timeout": "60.000000", 2023-01-25T09:39:56.768 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_target_pg_per_osd": "100", 2023-01-25T09:39:56.768 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_tick_interval": "5", 2023-01-25T09:39:56.768 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_timecheck_interval": "300.000000", 2023-01-25T09:39:56.768 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-01-25T09:39:56.768 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_use_min_delay_socket": "false", 2023-01-25T09:39:56.769 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_older_version_delay": "604800", 2023-01-25T09:39:56.769 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-01-25T09:39:56.769 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-01-25T09:39:56.769 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-01-25T09:39:56.769 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_filestore_osds": "false", 2023-01-25T09:39:56.770 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-01-25T09:39:56.770 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-01-25T09:39:56.770 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-01-25T09:39:56.770 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_misplaced": "false", 2023-01-25T09:39:56.770 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-01-25T09:39:56.771 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_older_version": "true", 2023-01-25T09:39:56.771 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-01-25T09:39:56.771 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_pool_no_app": "true", 2023-01-25T09:39:56.771 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-01-25T09:39:56.771 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-01-25T09:39:56.772 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-01-25T09:39:56.772 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-01-25T09:39:56.772 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_on_too_few_osds": "false", 2023-01-25T09:39:56.772 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-01-25T09:39:56.772 INFO:teuthology.orchestra.run.smithi035.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-01-25T09:39:56.773 INFO:teuthology.orchestra.run.smithi035.stdout: "monmap": "", 2023-01-25T09:39:56.773 INFO:teuthology.orchestra.run.smithi035.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2023-01-25T09:39:56.773 INFO:teuthology.orchestra.run.smithi035.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-01-25T09:39:56.773 INFO:teuthology.orchestra.run.smithi035.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2023-01-25T09:39:56.773 INFO:teuthology.orchestra.run.smithi035.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2023-01-25T09:39:56.774 INFO:teuthology.orchestra.run.smithi035.stdout: "motr_tracing_enabled": "false", 2023-01-25T09:39:56.774 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_op_threads": "3", 2023-01-25T09:39:56.774 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_buffer_size": "131072", 2023-01-25T09:39:56.774 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_cm": "false", 2023-01-25T09:39:56.774 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_device_name": "", 2023-01-25T09:39:56.775 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_dscp": "96", 2023-01-25T09:39:56.775 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-01-25T09:39:56.775 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_gid_idx": "0", 2023-01-25T09:39:56.775 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_local_gid": "", 2023-01-25T09:39:56.775 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_polling_us": "1000", 2023-01-25T09:39:56.776 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_port_num": "1", 2023-01-25T09:39:56.776 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-01-25T09:39:56.776 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-01-25T09:39:56.776 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_roce_ver": "1", 2023-01-25T09:39:56.776 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_send_buffers": "1024", 2023-01-25T09:39:56.777 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_sl": "3", 2023-01-25T09:39:56.777 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_support_srq": "true", 2023-01-25T09:39:56.777 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_rdma_type": "ib", 2023-01-25T09:39:56.777 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_async_reap_threshold": "5", 2023-01-25T09:39:56.777 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_bind_before_connect": "false", 2023-01-25T09:39:56.778 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_bind_ipv4": "true", 2023-01-25T09:39:56.778 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_bind_ipv6": "false", 2023-01-25T09:39:56.778 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_bind_msgr1": "true", 2023-01-25T09:39:56.778 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_bind_msgr2": "false", 2023-01-25T09:39:56.778 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_bind_port_max": "7568", 2023-01-25T09:39:56.778 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_bind_port_min": "6800", 2023-01-25T09:39:56.779 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_bind_prefer_ipv4": "false", 2023-01-25T09:39:56.779 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_bind_retry_count": "3", 2023-01-25T09:39:56.779 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_bind_retry_delay": "5", 2023-01-25T09:39:56.779 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_blackhole_client": "false", 2023-01-25T09:39:56.779 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_blackhole_mds": "false", 2023-01-25T09:39:56.780 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_blackhole_mgr": "false", 2023-01-25T09:39:56.780 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_blackhole_mon": "false", 2023-01-25T09:39:56.780 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_blackhole_osd": "false", 2023-01-25T09:39:56.780 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_client_mode": "crc secure", 2023-01-25T09:39:56.781 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_cluster_mode": "crc secure", 2023-01-25T09:39:56.781 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_cluster_type": "", 2023-01-25T09:39:56.781 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_compress_secure": "false", 2023-01-25T09:39:56.781 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_connection_idle_timeout": "900", 2023-01-25T09:39:56.781 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_connection_ready_timeout": "10", 2023-01-25T09:39:56.782 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_crc_data": "true", 2023-01-25T09:39:56.782 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_crc_header": "true", 2023-01-25T09:39:56.782 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_die_on_bad_msg": "false", 2023-01-25T09:39:56.782 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_die_on_bug": "true", 2023-01-25T09:39:56.782 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_die_on_old_message": "true", 2023-01-25T09:39:56.782 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_die_on_skipped_message": "false", 2023-01-25T09:39:56.783 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_die_on_unhandled_msg": "false", 2023-01-25T09:39:56.783 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-01-25T09:39:56.783 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_coremask": "0xF", 2023-01-25T09:39:56.783 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-01-25T09:39:56.783 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_devs_allowlist": "", 2023-01-25T09:39:56.783 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_enable_tso": "true", 2023-01-25T09:39:56.784 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-01-25T09:39:56.784 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-01-25T09:39:56.784 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_hugepages": "", 2023-01-25T09:39:56.784 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_hw_flow_control": "true", 2023-01-25T09:39:56.784 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-01-25T09:39:56.785 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_lro": "true", 2023-01-25T09:39:56.785 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_memory_channel": "4", 2023-01-25T09:39:56.785 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-01-25T09:39:56.785 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_pmd": "", 2023-01-25T09:39:56.786 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_port_id": "0", 2023-01-25T09:39:56.786 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-01-25T09:39:56.786 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dump_corrupt_message_level": "1", 2023-01-25T09:39:56.786 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_dump_on_send": "false", 2023-01-25T09:39:56.786 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_initial_backoff": "0.200000", 2023-01-25T09:39:56.787 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_inject_delay_max": "1.000000", 2023-01-25T09:39:56.787 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_inject_delay_probability": "0.000000", 2023-01-25T09:39:56.787 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_inject_delay_type": "", 2023-01-25T09:39:56.787 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_inject_internal_delays": "0.000000", 2023-01-25T09:39:56.787 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_inject_network_congestion": "0", 2023-01-25T09:39:56.788 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_inject_socket_failures": "2500", 2023-01-25T09:39:56.788 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_learn_addr_from_peer": "true", 2023-01-25T09:39:56.788 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_max_accept_failures": "4", 2023-01-25T09:39:56.788 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_max_backoff": "15.000000", 2023-01-25T09:39:56.788 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_mon_client_mode": "secure crc", 2023-01-25T09:39:56.788 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_mon_cluster_mode": "secure crc", 2023-01-25T09:39:56.789 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_mon_service_mode": "secure crc", 2023-01-25T09:39:56.789 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_osd_compress_min_size": "1024", 2023-01-25T09:39:56.789 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_osd_compress_mode": "none", 2023-01-25T09:39:56.789 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_osd_compression_algorithm": "snappy zlib zstd lz4", 2023-01-25T09:39:56.789 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2023-01-25T09:39:56.790 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_pq_min_cost": "65536", 2023-01-25T09:39:56.790 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_public_type": "", 2023-01-25T09:39:56.790 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_service_mode": "crc secure", 2023-01-25T09:39:56.790 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_tcp_listen_backlog": "512", 2023-01-25T09:39:56.790 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_tcp_nodelay": "true", 2023-01-25T09:39:56.791 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_tcp_prefetch_max_size": "4096", 2023-01-25T09:39:56.791 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_tcp_rcvbuf": "0", 2023-01-25T09:39:56.791 INFO:teuthology.orchestra.run.smithi035.stdout: "ms_type": "async", 2023-01-25T09:39:56.791 INFO:teuthology.orchestra.run.smithi035.stdout: "no_config_file": "false", 2023-01-25T09:39:56.791 INFO:teuthology.orchestra.run.smithi035.stdout: "objecter_completion_locks_per_session": "32", 2023-01-25T09:39:56.792 INFO:teuthology.orchestra.run.smithi035.stdout: "objecter_debug_inject_relock_delay": "false", 2023-01-25T09:39:56.792 INFO:teuthology.orchestra.run.smithi035.stdout: "objecter_inflight_op_bytes": "104857600", 2023-01-25T09:39:56.792 INFO:teuthology.orchestra.run.smithi035.stdout: "objecter_inflight_ops": "1024", 2023-01-25T09:39:56.792 INFO:teuthology.orchestra.run.smithi035.stdout: "objecter_inject_no_watch_ping": "false", 2023-01-25T09:39:56.792 INFO:teuthology.orchestra.run.smithi035.stdout: "objecter_retry_writes_after_first_reply": "false", 2023-01-25T09:39:56.793 INFO:teuthology.orchestra.run.smithi035.stdout: "objecter_tick_interval": "5.000000", 2023-01-25T09:39:56.793 INFO:teuthology.orchestra.run.smithi035.stdout: "objecter_timeout": "10.000000", 2023-01-25T09:39:56.793 INFO:teuthology.orchestra.run.smithi035.stdout: "objectstore_blackhole": "false", 2023-01-25T09:39:56.793 INFO:teuthology.orchestra.run.smithi035.stdout: "openssl_engine_opts": "", 2023-01-25T09:39:56.793 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_agent_delay_time": "5.000000", 2023-01-25T09:39:56.793 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_agent_hist_halflife": "1000", 2023-01-25T09:39:56.794 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_agent_max_low_ops": "2", 2023-01-25T09:39:56.794 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_agent_max_ops": "4", 2023-01-25T09:39:56.794 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_agent_min_evict_effort": "0.100000", 2023-01-25T09:39:56.794 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_agent_quantize_effort": "0.100000", 2023-01-25T09:39:56.794 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_agent_slop": "0.020000", 2023-01-25T09:39:56.795 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_aggregated_slow_ops_logging": "true", 2023-01-25T09:39:56.795 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_allow_recovery_below_min_size": "true", 2023-01-25T09:39:56.795 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_asio_thread_count": "2", 2023-01-25T09:39:56.795 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_async_recovery_min_cost": "100", 2023-01-25T09:39:56.795 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_auto_mark_unfound_lost": "false", 2023-01-25T09:39:56.796 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_backfill_retry_interval": "30.000000", 2023-01-25T09:39:56.796 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_backfill_scan_max": "512", 2023-01-25T09:39:56.796 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_backfill_scan_min": "64", 2023-01-25T09:39:56.796 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_backoff_on_degraded": "false", 2023-01-25T09:39:56.796 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_backoff_on_peering": "false", 2023-01-25T09:39:56.797 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_backoff_on_unfound": "true", 2023-01-25T09:39:56.797 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_beacon_report_interval": "300", 2023-01-25T09:39:56.797 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_bench_duration": "30", 2023-01-25T09:39:56.797 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_bench_large_size_max_throughput": "104857600", 2023-01-25T09:39:56.797 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_bench_max_block_size": "67108864", 2023-01-25T09:39:56.798 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_bench_small_size_max_iops": "100", 2023-01-25T09:39:56.798 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_blkin_trace_all": "false", 2023-01-25T09:39:56.798 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_blocked_scrub_grace_period": "120", 2023-01-25T09:39:56.798 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2023-01-25T09:39:56.798 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2023-01-25T09:39:56.799 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2023-01-25T09:39:56.799 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_check_for_log_corruption": "false", 2023-01-25T09:39:56.799 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_check_max_object_name_len_on_startup": "true", 2023-01-25T09:39:56.799 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-01-25T09:39:56.799 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2023-01-25T09:39:56.799 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-01-25T09:39:56.800 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_class_update_on_start": "true", 2023-01-25T09:39:56.800 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_client_message_cap": "256", 2023-01-25T09:39:56.800 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_client_message_size_cap": "524288000", 2023-01-25T09:39:56.800 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_client_op_priority": "63", 2023-01-25T09:39:56.800 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_client_watch_timeout": "30", 2023-01-25T09:39:56.801 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_command_max_records": "256", 2023-01-25T09:39:56.801 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_compact_on_start": "false", 2023-01-25T09:39:56.801 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_copyfrom_max_chunk": "8388608", 2023-01-25T09:39:56.801 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_crush_chooseleaf_type": "0", 2023-01-25T09:39:56.801 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_crush_initial_weight": "-1.000000", 2023-01-25T09:39:56.802 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_crush_update_on_start": "true", 2023-01-25T09:39:56.802 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_crush_update_weight_set": "true", 2023-01-25T09:39:56.802 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2023-01-25T09:39:56.802 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2023-01-25T09:39:56.802 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2023-01-25T09:39:56.803 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_drop_ping_duration": "0", 2023-01-25T09:39:56.803 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_drop_ping_probability": "0.000000", 2023-01-25T09:39:56.803 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_feed_pullee": "-1", 2023-01-25T09:39:56.803 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_inject_copyfrom_error": "false", 2023-01-25T09:39:56.803 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2023-01-25T09:39:56.804 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2023-01-25T09:39:56.804 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_misdirected_ops": "false", 2023-01-25T09:39:56.804 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_no_acting_change": "false", 2023-01-25T09:39:56.804 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_no_purge_strays": "false", 2023-01-25T09:39:56.804 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_op_order": "false", 2023-01-25T09:39:56.805 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_pg_log_writeout": "false", 2023-01-25T09:39:56.805 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_pretend_recovery_active": "false", 2023-01-25T09:39:56.805 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_random_push_read_error": "0.000000", 2023-01-25T09:39:56.805 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2023-01-25T09:39:56.805 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_shutdown": "false", 2023-01-25T09:39:56.806 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2023-01-25T09:39:56.806 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2023-01-25T09:39:56.806 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_verify_cached_snaps": "false", 2023-01-25T09:39:56.806 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_verify_missing_on_start": "false", 2023-01-25T09:39:56.807 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_verify_snaps": "false", 2023-01-25T09:39:56.807 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_debug_verify_stray_on_activate": "false", 2023-01-25T09:39:56.807 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_deep_scrub_interval": "604800.000000", 2023-01-25T09:39:56.807 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_deep_scrub_keys": "1024", 2023-01-25T09:39:56.807 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2023-01-25T09:39:56.808 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2023-01-25T09:39:56.808 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2023-01-25T09:39:56.808 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_deep_scrub_stride": "524288", 2023-01-25T09:39:56.808 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2023-01-25T09:39:56.809 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_default_data_pool_replay_window": "5", 2023-01-25T09:39:56.809 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_default_notify_timeout": "30", 2023-01-25T09:39:56.809 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_delete_sleep": "0.000000", 2023-01-25T09:39:56.809 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_delete_sleep_hdd": "5.000000", 2023-01-25T09:39:56.809 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_delete_sleep_hybrid": "1.000000", 2023-01-25T09:39:56.810 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_delete_sleep_ssd": "1.000000", 2023-01-25T09:39:56.810 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_discard_disconnected_ops": "true", 2023-01-25T09:39:56.810 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_enable_op_tracker": "true", 2023-01-25T09:39:56.810 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2023-01-25T09:39:56.810 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_extblkdev_plugins": "vdo", 2023-01-25T09:39:56.811 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_failsafe_full_ratio": "0.970000", 2023-01-25T09:39:56.811 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_fast_fail_on_connection_refused": "true", 2023-01-25T09:39:56.811 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_fast_info": "true", 2023-01-25T09:39:56.811 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_fast_shutdown": "true", 2023-01-25T09:39:56.811 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_fast_shutdown_notify_mon": "true", 2023-01-25T09:39:56.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_fast_shutdown_timeout": "15", 2023-01-25T09:39:56.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_find_best_info_ignore_history_les": "false", 2023-01-25T09:39:56.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_force_auth_primary_missing_objects": "100", 2023-01-25T09:39:56.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2023-01-25T09:39:56.812 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_function_tracing": "false", 2023-01-25T09:39:56.813 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_heartbeat_grace": "20", 2023-01-25T09:39:56.813 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_heartbeat_interval": "6", 2023-01-25T09:39:56.813 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2023-01-25T09:39:56.813 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_heartbeat_min_peers": "10", 2023-01-25T09:39:56.813 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_heartbeat_min_size": "2000", 2023-01-25T09:39:56.814 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_heartbeat_stale": "600", 2023-01-25T09:39:56.814 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2023-01-25T09:39:56.814 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_hit_set_max_size": "100000", 2023-01-25T09:39:56.814 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_hit_set_min_size": "1000", 2023-01-25T09:39:56.814 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_hit_set_namespace": ".ceph-internal", 2023-01-25T09:39:56.814 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_ignore_stale_divergent_priors": "false", 2023-01-25T09:39:56.815 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2023-01-25T09:39:56.815 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_inject_failure_on_pg_removal": "false", 2023-01-25T09:39:56.815 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2023-01-25T09:39:56.815 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_journal_flush_on_shutdown": "true", 2023-01-25T09:39:56.815 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_journal_size": "5120", 2023-01-25T09:39:56.816 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_kill_backfill_at": "0", 2023-01-25T09:39:56.816 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_loop_before_reset_tphandle": "64", 2023-01-25T09:39:56.816 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_map_cache_size": "50", 2023-01-25T09:39:56.816 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_map_dedup": "true", 2023-01-25T09:39:56.816 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_map_message_max": "40", 2023-01-25T09:39:56.817 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_map_message_max_bytes": "10485760", 2023-01-25T09:39:56.817 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_map_share_max_epochs": "40", 2023-01-25T09:39:56.817 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_attr_name_len": "100", 2023-01-25T09:39:56.817 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_attr_size": "0", 2023-01-25T09:39:56.817 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_backfills": "1", 2023-01-25T09:39:56.818 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_markdown_count": "5", 2023-01-25T09:39:56.818 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_markdown_period": "600", 2023-01-25T09:39:56.818 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_object_name_len": "2048", 2023-01-25T09:39:56.818 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_object_namespace_len": "256", 2023-01-25T09:39:56.818 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_object_size": "134217728", 2023-01-25T09:39:56.818 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2023-01-25T09:39:56.819 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_omap_entries_per_request": "1024", 2023-01-25T09:39:56.819 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_pg_blocked_by": "16", 2023-01-25T09:39:56.819 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_pg_log_entries": "2", 2023-01-25T09:39:56.819 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2023-01-25T09:39:56.819 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_pgls": "1024", 2023-01-25T09:39:56.819 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_push_cost": "8388608", 2023-01-25T09:39:56.820 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_push_objects": "10", 2023-01-25T09:39:56.820 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_scrubs": "1", 2023-01-25T09:39:56.820 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2023-01-25T09:39:56.820 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_trimming_pgs": "2", 2023-01-25T09:39:56.820 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_write_op_reply_len": "64", 2023-01-25T09:39:56.821 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_max_write_size": "90", 2023-01-25T09:39:56.821 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_cost_per_byte_usec": "0.000000", 2023-01-25T09:39:56.821 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_cost_per_byte_usec_hdd": "2.600000", 2023-01-25T09:39:56.821 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_cost_per_byte_usec_ssd": "0.011000", 2023-01-25T09:39:56.821 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_cost_per_io_usec": "0.000000", 2023-01-25T09:39:56.821 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_cost_per_io_usec_hdd": "11400.000000", 2023-01-25T09:39:56.822 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_cost_per_io_usec_ssd": "50.000000", 2023-01-25T09:39:56.822 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2023-01-25T09:39:56.822 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2023-01-25T09:39:56.822 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2023-01-25T09:39:56.822 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2023-01-25T09:39:56.823 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2023-01-25T09:39:56.823 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_override_recovery_settings": "false", 2023-01-25T09:39:56.823 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_profile": "high_client_ops", 2023-01-25T09:39:56.823 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2023-01-25T09:39:56.823 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_scheduler_background_best_effort_lim": "999999", 2023-01-25T09:39:56.823 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_scheduler_background_best_effort_res": "1", 2023-01-25T09:39:56.824 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2023-01-25T09:39:56.824 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_scheduler_background_recovery_lim": "999999", 2023-01-25T09:39:56.824 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_scheduler_background_recovery_res": "1", 2023-01-25T09:39:56.824 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2023-01-25T09:39:56.824 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_scheduler_client_lim": "999999", 2023-01-25T09:39:56.825 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_scheduler_client_res": "1", 2023-01-25T09:39:56.825 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_scheduler_client_wgt": "1", 2023-01-25T09:39:56.825 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mclock_skip_benchmark": "false", 2023-01-25T09:39:56.825 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_memory_base": "805306368", 2023-01-25T09:39:56.825 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_memory_cache_min": "134217728", 2023-01-25T09:39:56.826 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_memory_cache_resize_interval": "1.000000", 2023-01-25T09:39:56.826 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_memory_expected_fragmentation": "0.150000", 2023-01-25T09:39:56.826 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_memory_target": "4294967296", 2023-01-25T09:39:56.826 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_memory_target_autotune": "false", 2023-01-25T09:39:56.826 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2023-01-25T09:39:56.827 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_min_pg_log_entries": "1", 2023-01-25T09:39:56.827 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_min_recovery_priority": "0", 2023-01-25T09:39:56.827 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mon_heartbeat_interval": "30", 2023-01-25T09:39:56.827 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2023-01-25T09:39:56.827 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mon_report_interval": "5", 2023-01-25T09:39:56.828 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mon_report_max_in_flight": "2", 2023-01-25T09:39:56.828 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_mon_shutdown_timeout": "5.000000", 2023-01-25T09:39:56.828 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_num_cache_shards": "32", 2023-01-25T09:39:56.828 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_num_op_tracker_shard": "32", 2023-01-25T09:39:56.828 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_numa_auto_affinity": "true", 2023-01-25T09:39:56.829 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_numa_node": "-1", 2023-01-25T09:39:56.829 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_numa_prefer_iface": "true", 2023-01-25T09:39:56.829 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_object_clean_region_max_num_intervals": "10", 2023-01-25T09:39:56.829 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_objecter_finishers": "1", 2023-01-25T09:39:56.829 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_objectstore": "bluestore", 2023-01-25T09:39:56.829 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_objectstore_fuse": "false", 2023-01-25T09:39:56.830 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_objectstore_tracing": "false", 2023-01-25T09:39:56.830 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_complaint_time": "30.000000", 2023-01-25T09:39:56.830 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_history_duration": "600", 2023-01-25T09:39:56.830 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_history_size": "20", 2023-01-25T09:39:56.830 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_history_slow_op_size": "20", 2023-01-25T09:39:56.830 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2023-01-25T09:39:56.831 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_log_threshold": "5", 2023-01-25T09:39:56.831 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_num_shards": "0", 2023-01-25T09:39:56.831 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_num_shards_hdd": "5", 2023-01-25T09:39:56.831 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_num_shards_ssd": "8", 2023-01-25T09:39:56.831 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_num_threads_per_shard": "0", 2023-01-25T09:39:56.832 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2023-01-25T09:39:56.832 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2023-01-25T09:39:56.832 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2023-01-25T09:39:56.832 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_pq_min_cost": "65536", 2023-01-25T09:39:56.832 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_queue": "mclock_scheduler", 2023-01-25T09:39:56.833 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_queue_cut_off": "high", 2023-01-25T09:39:56.833 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_thread_suicide_timeout": "150", 2023-01-25T09:39:56.833 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_op_thread_timeout": "15", 2023-01-25T09:39:56.833 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_open_classes_on_start": "true", 2023-01-25T09:39:56.833 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_os_flags": "0", 2023-01-25T09:39:56.834 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_peering_op_priority": "255", 2023-01-25T09:39:56.834 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pg_delete_cost": "1048576", 2023-01-25T09:39:56.834 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pg_delete_priority": "5", 2023-01-25T09:39:56.834 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2023-01-25T09:39:56.834 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2023-01-25T09:39:56.835 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pg_log_dups_tracked": "3000", 2023-01-25T09:39:56.835 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pg_log_trim_max": "10000", 2023-01-25T09:39:56.835 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pg_log_trim_min": "0", 2023-01-25T09:39:56.835 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2023-01-25T09:39:56.835 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pg_object_context_cache_count": "64", 2023-01-25T09:39:56.835 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pg_stat_report_interval_max": "500", 2023-01-25T09:39:56.836 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2023-01-25T09:39:56.836 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_cache_min_evict_age": "0", 2023-01-25T09:39:56.836 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_cache_min_flush_age": "0", 2023-01-25T09:39:56.836 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2023-01-25T09:39:56.836 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2023-01-25T09:39:56.837 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2023-01-25T09:39:56.837 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_crush_rule": "-1", 2023-01-25T09:39:56.837 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_ec_fast_read": "false", 2023-01-25T09:39:56.837 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2023-01-25T09:39:56.837 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_flag_bulk": "false", 2023-01-25T09:39:56.838 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_flag_hashpspool": "true", 2023-01-25T09:39:56.838 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_flag_nodelete": "false", 2023-01-25T09:39:56.838 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_flag_nopgchange": "false", 2023-01-25T09:39:56.838 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_flag_nosizechange": "false", 2023-01-25T09:39:56.838 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_flags": "0", 2023-01-25T09:39:56.839 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2023-01-25T09:39:56.839 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_min_size": "2", 2023-01-25T09:39:56.839 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2023-01-25T09:39:56.839 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_pg_num": "32", 2023-01-25T09:39:56.839 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_pgp_num": "0", 2023-01-25T09:39:56.840 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2023-01-25T09:39:56.840 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_size": "3", 2023-01-25T09:39:56.840 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_default_type": "replicated", 2023-01-25T09:39:56.840 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2023-01-25T09:39:56.840 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_pool_use_gmt_hitset": "true", 2023-01-25T09:39:56.841 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_push_per_object_cost": "1000", 2023-01-25T09:39:56.841 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_read_ec_check_for_errors": "false", 2023-01-25T09:39:56.841 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recover_clone_overlap": "true", 2023-01-25T09:39:56.841 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recover_clone_overlap_limit": "10", 2023-01-25T09:39:56.841 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_cost": "20971520", 2023-01-25T09:39:56.842 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_delay_start": "0.000000", 2023-01-25T09:39:56.842 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_max_active": "0", 2023-01-25T09:39:56.842 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_max_active_hdd": "3", 2023-01-25T09:39:56.842 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_max_active_ssd": "10", 2023-01-25T09:39:56.842 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_max_chunk": "8388608", 2023-01-25T09:39:56.843 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2023-01-25T09:39:56.843 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_max_single_start": "1", 2023-01-25T09:39:56.843 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_op_priority": "3", 2023-01-25T09:39:56.843 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_op_warn_multiple": "16", 2023-01-25T09:39:56.843 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_priority": "5", 2023-01-25T09:39:56.843 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_retry_interval": "30.000000", 2023-01-25T09:39:56.844 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_sleep": "0.000000", 2023-01-25T09:39:56.844 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_sleep_hdd": "0.100000", 2023-01-25T09:39:56.844 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2023-01-25T09:39:56.844 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_recovery_sleep_ssd": "0.000000", 2023-01-25T09:39:56.845 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_repair_during_recovery": "false", 2023-01-25T09:39:56.845 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_requested_scrub_priority": "120", 2023-01-25T09:39:56.845 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2023-01-25T09:39:56.845 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_rollback_to_cluster_snap": "", 2023-01-25T09:39:56.845 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_auto_repair": "false", 2023-01-25T09:39:56.846 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_auto_repair_num_errors": "5", 2023-01-25T09:39:56.846 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_backoff_ratio": "0.660000", 2023-01-25T09:39:56.846 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_begin_hour": "0", 2023-01-25T09:39:56.846 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_begin_week_day": "0", 2023-01-25T09:39:56.846 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_chunk_max": "25", 2023-01-25T09:39:56.847 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_chunk_min": "5", 2023-01-25T09:39:56.847 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_cost": "52428800", 2023-01-25T09:39:56.847 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_during_recovery": "false", 2023-01-25T09:39:56.847 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_end_hour": "0", 2023-01-25T09:39:56.848 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_end_week_day": "0", 2023-01-25T09:39:56.848 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_extended_sleep": "0.000000", 2023-01-25T09:39:56.848 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2023-01-25T09:39:56.848 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_invalid_stats": "true", 2023-01-25T09:39:56.848 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_load_threshold": "0.500000", 2023-01-25T09:39:56.849 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_max_interval": "604800.000000", 2023-01-25T09:39:56.849 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_max_preemptions": "5", 2023-01-25T09:39:56.849 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_min_interval": "86400.000000", 2023-01-25T09:39:56.849 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_priority": "5", 2023-01-25T09:39:56.850 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_reservation_timeout": "5000", 2023-01-25T09:39:56.850 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_sleep": "0.000000", 2023-01-25T09:39:56.850 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_scrub_slow_reservation_response": "2200", 2023-01-25T09:39:56.850 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_shutdown_pgref_assert": "false", 2023-01-25T09:39:56.850 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_skip_data_digest": "false", 2023-01-25T09:39:56.851 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_smart_report_timeout": "5", 2023-01-25T09:39:56.851 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_snap_trim_cost": "1048576", 2023-01-25T09:39:56.851 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_snap_trim_priority": "5", 2023-01-25T09:39:56.851 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_snap_trim_sleep": "0.000000", 2023-01-25T09:39:56.851 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2023-01-25T09:39:56.852 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2023-01-25T09:39:56.852 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2023-01-25T09:39:56.852 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_stats_update_period_not_scrubbing": "120", 2023-01-25T09:39:56.852 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_stats_update_period_scrubbing": "15", 2023-01-25T09:39:56.852 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2023-01-25T09:39:56.853 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_target_transaction_size": "30", 2023-01-25T09:39:56.853 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_tier_default_cache_hit_set_count": "4", 2023-01-25T09:39:56.853 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2023-01-25T09:39:56.853 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2023-01-25T09:39:56.853 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2023-01-25T09:39:56.854 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2023-01-25T09:39:56.854 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2023-01-25T09:39:56.854 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2023-01-25T09:39:56.854 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_tier_default_cache_mode": "writeback", 2023-01-25T09:39:56.854 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2023-01-25T09:39:56.854 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_tier_promote_max_objects_sec": "25", 2023-01-25T09:39:56.855 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_tracing": "false", 2023-01-25T09:39:56.855 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_use_stale_snap": "false", 2023-01-25T09:39:56.855 INFO:teuthology.orchestra.run.smithi035.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2023-01-25T09:39:56.855 INFO:teuthology.orchestra.run.smithi035.stdout: "osdc_blkin_trace_all": "false", 2023-01-25T09:39:56.855 INFO:teuthology.orchestra.run.smithi035.stdout: "paxos_kill_at": "0", 2023-01-25T09:39:56.856 INFO:teuthology.orchestra.run.smithi035.stdout: "paxos_max_join_drift": "10", 2023-01-25T09:39:56.856 INFO:teuthology.orchestra.run.smithi035.stdout: "paxos_min": "500", 2023-01-25T09:39:56.856 INFO:teuthology.orchestra.run.smithi035.stdout: "paxos_min_wait": "0.050000", 2023-01-25T09:39:56.856 INFO:teuthology.orchestra.run.smithi035.stdout: "paxos_propose_interval": "1.000000", 2023-01-25T09:39:56.856 INFO:teuthology.orchestra.run.smithi035.stdout: "paxos_service_trim_max": "500", 2023-01-25T09:39:56.857 INFO:teuthology.orchestra.run.smithi035.stdout: "paxos_service_trim_max_multiplier": "20", 2023-01-25T09:39:56.857 INFO:teuthology.orchestra.run.smithi035.stdout: "