2023-01-24T21:52:48.132 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1 2023-01-24T21:52:48.133 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi/7135861 --verbose -- /home/teuthworker/archive/yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi/7135861/orig.config.yaml 2023-01-24T21:52:48.177 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-24T21:52:48.241 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi/7135861 branch: wip-yuri7-testing-2023-01-23-1532-quincy description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} email: yweinstein@radhat.com first_in_suite: false job_id: '7135861' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri7-testing-2023-01-23-1532-quincy ceph: conf: global: mon election default strategy: 1 ms type: async osd debug inject dispatch delay duration: 0.1 osd debug inject dispatch delay probability: 0.1 osd_async_recovery_min_cost: 1 osd_object_clean_region_max_num_intervals: 1000 osd_pool_default_min_size: 2 osd_pool_default_size: 2 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bluestore zero block detection: true debug ms: 1 debug osd: 20 osd backoff on degraded: true osd backoff on peering: true osd debug verify cached snaps: true osd debug verify missing on start: true osd inject bad map crc probability: 0.1 osd map cache size: 1 osd max backfills: 6 osd max markdown count: 1000 osd mclock override recovery settings: true osd objectstore: filestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub during recovery: false osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd sloppy crc: true osd_max_pg_log_entries: 3000 osd_min_pg_log_entries: 3000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(REQUEST_STUCK\) - failed to encode map - but it is still running - objects unfound and apparently lost - osd_map_cache_size - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - must scrub before tier agent can activate sha1: 49f8fb05584886826e8eade75f7105fba754560c ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: default sha1: 49f8fb05584886826e8eade75f7105fba754560c workunit: branch: wip-yuri7-testing-2023-01-23-1532-quincy sha1: 49f8fb05584886826e8eade75f7105fba754560c owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 49f8fb05584886826e8eade75f7105fba754560c sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri7-testing-2023-01-23-1532-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_49f8fb05584886826e8eade75f7105fba754560c/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 49f8fb05584886826e8eade75f7105fba754560c targets: smithi100.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi149.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: null - ceph: conf: osd: debug monc: 20 - exec: mon.a: - while ! ceph balancer status ; do sleep 1 ; done - ceph balancer mode crush-compat - ceph balancer on - thrashosds: chance_pgnum_grow: 0.25 chance_pgnum_shrink: 0.25 chance_pgpnum_fix: 0.25 chance_test_map_discontinuity: 2 timeout: 1800 - exec: client.0: - sudo ceph osd pool create base 4 - sudo ceph osd pool application enable base rados - sudo ceph osd pool create cache 4 - sudo ceph osd tier add base cache - sudo ceph osd tier cache-mode cache readproxy - sudo ceph osd tier set-overlay base cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 3600 - sudo ceph osd pool set cache target_max_objects 250 - rados: clients: - client.0 objects: 500 op_weights: cache_evict: 50 cache_flush: 50 cache_try_flush: 50 copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 pool_snaps: true pools: - base teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e1bba12e584b7ae912e92e94afe9c075ab51fa3 timestamp: 2023-01-24_16:05:13 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.17735 2023-01-24T21:52:48.241 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_49f8fb05584886826e8eade75f7105fba754560c/qa; will attempt to use it 2023-01-24T21:52:48.242 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_49f8fb05584886826e8eade75f7105fba754560c/qa/tasks 2023-01-24T21:52:48.242 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-24T21:52:48.253 INFO:teuthology.task.internal:Checking packages... 2023-01-24T21:52:48.282 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '49f8fb05584886826e8eade75f7105fba754560c' 2023-01-24T21:52:48.283 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-24T21:52:48.283 INFO:teuthology.packaging:ref: None 2023-01-24T21:52:48.283 INFO:teuthology.packaging:tag: None 2023-01-24T21:52:48.284 INFO:teuthology.packaging:branch: wip-yuri7-testing-2023-01-23-1532-quincy 2023-01-24T21:52:48.284 INFO:teuthology.packaging:sha1: 49f8fb05584886826e8eade75f7105fba754560c 2023-01-24T21:52:48.284 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri7-testing-2023-01-23-1532-quincy 2023-01-24T21:52:48.434 INFO:teuthology.task.internal:Found packages for ceph version 17.2.5-727-g49f8fb05-1focal 2023-01-24T21:52:48.434 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-24T21:52:48.441 INFO:teuthology.task.internal:no buildpackages task found 2023-01-24T21:52:48.441 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-24T21:52:48.457 INFO:teuthology.task.internal:Saving configuration 2023-01-24T21:52:48.475 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-24T21:52:48.482 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-24T21:52:48.505 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi/7135861', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-24 21:46:38.466738', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-01-24T21:52:48.525 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi/7135861', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-24 21:46:38.465359', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-01-24T21:52:48.526 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-24T21:52:48.532 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-01-24T21:52:48.532 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-01-24T21:52:48.533 INFO:teuthology.run_tasks:Running task console_log... 2023-01-24T21:52:48.598 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1188525670>, signals=[15]) 2023-01-24T21:52:48.599 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-24T21:52:48.605 INFO:teuthology.task.internal:Opening connections... 2023-01-24T21:52:48.606 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2023-01-24T21:52:48.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-24T21:52:48.659 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2023-01-24T21:52:48.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-24T21:52:48.714 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-24T21:52:48.723 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2023-01-24T21:52:48.737 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2023-01-24T21:52:48.738 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2023-01-24T21:52:48.788 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu" 2023-01-24T21:52:48.788 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-24T21:52:48.789 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu 2023-01-24T21:52:48.789 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian 2023-01-24T21:52:48.789 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-24T21:52:48.790 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="20.04" 2023-01-24T21:52:48.790 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-24T21:52:48.790 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-24T21:52:48.791 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-24T21:52:48.791 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-24T21:52:48.791 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=focal 2023-01-24T21:52:48.792 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=focal 2023-01-24T21:52:48.793 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2023-01-24T21:52:48.810 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-01-24T21:52:48.816 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-01-24T21:52:48.817 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-01-24T21:52:48.823 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-01-24T21:52:48.824 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-24T21:52:48.824 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-01-24T21:52:48.824 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-01-24T21:52:48.825 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-24T21:52:48.825 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-01-24T21:52:48.825 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-24T21:52:48.825 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-24T21:52:48.825 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-24T21:52:48.826 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-24T21:52:48.826 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-01-24T21:52:48.826 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-01-24T21:52:48.826 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-01-24T21:52:48.842 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-24T21:52:48.855 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-24T21:52:48.863 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-24T21:52:48.864 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2023-01-24T21:52:48.866 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2023-01-24T21:52:48.874 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-24T21:52:48.886 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-24T21:52:48.886 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2023-01-24T21:52:48.888 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2023-01-24T21:52:48.903 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-24T21:52:48.961 INFO:teuthology.run_tasks:Running task kernel... 2023-01-24T21:52:48.984 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-24T21:52:48.985 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-24T21:52:48.985 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-24T21:52:48.986 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-24T21:52:48.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T21:52:48.992 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2023-01-24T21:52:48.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T21:52:48.994 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2023-01-24T21:52:49.000 INFO:teuthology.orchestra.run.smithi100.stdout:5.4.0-124-generic 2023-01-24T21:52:49.001 INFO:teuthology.task.kernel:Running kernel on smithi100: 5.4.0-124-generic 2023-01-24T21:52:49.001 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get clean 2023-01-24T21:52:49.043 INFO:teuthology.orchestra.run.smithi149.stdout:5.4.0-124-generic 2023-01-24T21:52:49.043 INFO:teuthology.task.kernel:Running kernel on smithi149: 5.4.0-124-generic 2023-01-24T21:52:49.044 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get clean 2023-01-24T21:52:49.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get update 2023-01-24T21:52:49.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get update 2023-01-24T21:52:49.260 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-24T21:52:49.276 INFO:teuthology.orchestra.run.smithi100.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-01-24T21:52:49.289 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-01-24T21:52:49.329 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-01-24T21:52:49.392 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-01-24T21:52:49.421 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-24T21:52:49.513 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-01-24T21:52:49.574 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [543 kB] 2023-01-24T21:52:49.653 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,336 kB] 2023-01-24T21:52:49.665 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,960 kB] 2023-01-24T21:52:49.702 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [320 kB] 2023-01-24T21:52:49.705 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [11.7 kB] 2023-01-24T21:52:49.705 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [29.1 kB] 2023-01-24T21:52:49.708 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,463 kB] 2023-01-24T21:52:49.718 INFO:teuthology.orchestra.run.smithi149.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [207 kB] 2023-01-24T21:52:49.720 INFO:teuthology.orchestra.run.smithi149.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [624 B] 2023-01-24T21:52:49.720 INFO:teuthology.orchestra.run.smithi149.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [576 kB] 2023-01-24T21:52:49.724 INFO:teuthology.orchestra.run.smithi149.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [787 kB] 2023-01-24T21:52:49.729 INFO:teuthology.orchestra.run.smithi149.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [152 kB] 2023-01-24T21:52:49.730 INFO:teuthology.orchestra.run.smithi149.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [16.9 kB] 2023-01-24T21:52:49.766 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [775 kB] 2023-01-24T21:52:49.767 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [403 kB] 2023-01-24T21:52:49.770 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.2 kB] 2023-01-24T21:52:49.770 INFO:teuthology.orchestra.run.smithi100.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [30.4 kB] 2023-01-24T21:52:49.771 INFO:teuthology.orchestra.run.smithi100.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,560 kB] 2023-01-24T21:52:49.782 INFO:teuthology.orchestra.run.smithi100.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [220 kB] 2023-01-24T21:52:49.785 INFO:teuthology.orchestra.run.smithi100.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [620 B] 2023-01-24T21:52:49.785 INFO:teuthology.orchestra.run.smithi100.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [708 kB] 2023-01-24T21:52:49.790 INFO:teuthology.orchestra.run.smithi100.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,017 kB] 2023-01-24T21:52:49.798 INFO:teuthology.orchestra.run.smithi100.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [236 kB] 2023-01-24T21:52:49.800 INFO:teuthology.orchestra.run.smithi100.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [23.2 kB] 2023-01-24T21:52:49.803 INFO:teuthology.orchestra.run.smithi100.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-01-24T21:52:49.803 INFO:teuthology.orchestra.run.smithi100.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-01-24T21:52:49.803 INFO:teuthology.orchestra.run.smithi100.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [604 B] 2023-01-24T21:52:49.804 INFO:teuthology.orchestra.run.smithi100.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-01-24T21:52:49.804 INFO:teuthology.orchestra.run.smithi100.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [24.9 kB] 2023-01-24T21:52:49.805 INFO:teuthology.orchestra.run.smithi100.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-01-24T21:52:49.898 INFO:teuthology.orchestra.run.smithi149.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-01-24T21:52:49.974 INFO:teuthology.orchestra.run.smithi100.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,960 kB] 2023-01-24T21:52:50.056 INFO:teuthology.orchestra.run.smithi149.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,349 kB] 2023-01-24T21:52:50.455 INFO:teuthology.orchestra.run.smithi149.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [775 kB] 2023-01-24T21:52:50.476 INFO:teuthology.orchestra.run.smithi100.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [543 kB] 2023-01-24T21:52:50.493 INFO:teuthology.orchestra.run.smithi149.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [403 kB] 2023-01-24T21:52:50.493 INFO:teuthology.orchestra.run.smithi100.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [320 kB] 2023-01-24T21:52:50.503 INFO:teuthology.orchestra.run.smithi100.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [11.7 kB] 2023-01-24T21:52:50.503 INFO:teuthology.orchestra.run.smithi100.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,463 kB] 2023-01-24T21:52:50.507 INFO:teuthology.orchestra.run.smithi149.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.2 kB] 2023-01-24T21:52:50.508 INFO:teuthology.orchestra.run.smithi149.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,560 kB] 2023-01-24T21:52:50.555 INFO:teuthology.orchestra.run.smithi149.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [30.4 kB] 2023-01-24T21:52:50.555 INFO:teuthology.orchestra.run.smithi149.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [220 kB] 2023-01-24T21:52:50.561 INFO:teuthology.orchestra.run.smithi149.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [620 B] 2023-01-24T21:52:50.562 INFO:teuthology.orchestra.run.smithi149.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,018 kB] 2023-01-24T21:52:50.576 INFO:teuthology.orchestra.run.smithi100.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [29.1 kB] 2023-01-24T21:52:50.577 INFO:teuthology.orchestra.run.smithi100.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [207 kB] 2023-01-24T21:52:50.583 INFO:teuthology.orchestra.run.smithi100.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [624 B] 2023-01-24T21:52:50.584 INFO:teuthology.orchestra.run.smithi100.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [576 kB] 2023-01-24T21:52:50.589 INFO:teuthology.orchestra.run.smithi149.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [708 kB] 2023-01-24T21:52:50.601 INFO:teuthology.orchestra.run.smithi100.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [787 kB] 2023-01-24T21:52:50.624 INFO:teuthology.orchestra.run.smithi149.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [236 kB] 2023-01-24T21:52:50.625 INFO:teuthology.orchestra.run.smithi100.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [152 kB] 2023-01-24T21:52:50.630 INFO:teuthology.orchestra.run.smithi100.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [16.9 kB] 2023-01-24T21:52:50.638 INFO:teuthology.orchestra.run.smithi149.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [23.2 kB] 2023-01-24T21:52:50.638 INFO:teuthology.orchestra.run.smithi149.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-01-24T21:52:50.639 INFO:teuthology.orchestra.run.smithi149.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-01-24T21:52:50.734 INFO:teuthology.orchestra.run.smithi149.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [604 B] 2023-01-24T21:52:50.734 INFO:teuthology.orchestra.run.smithi149.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [24.9 kB] 2023-01-24T21:52:50.734 INFO:teuthology.orchestra.run.smithi149.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-01-24T21:52:50.734 INFO:teuthology.orchestra.run.smithi149.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-01-24T21:52:53.182 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 13.8 MB in 2s (6,562 kB/s) 2023-01-24T21:52:53.379 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 13.8 MB in 2s (6,723 kB/s) 2023-01-24T21:52:54.550 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-01-24T21:52:54.574 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-24T21:52:54.640 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-01-24T21:52:54.709 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-01-24T21:52:54.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-24T21:52:54.805 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-01-24T21:52:54.806 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2023-01-24T21:52:54.807 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2023-01-24T21:52:54.961 INFO:teuthology.orchestra.run.smithi100.stdout:The following additional packages will be installed: 2023-01-24T21:52:54.962 INFO:teuthology.orchestra.run.smithi100.stdout: linux-generic linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-24T21:52:54.962 INFO:teuthology.orchestra.run.smithi100.stdout: linux-headers-generic linux-image-5.4.0-137-generic 2023-01-24T21:52:54.962 INFO:teuthology.orchestra.run.smithi100.stdout: linux-modules-5.4.0-137-generic linux-modules-extra-5.4.0-137-generic 2023-01-24T21:52:54.962 INFO:teuthology.orchestra.run.smithi100.stdout:Suggested packages: 2023-01-24T21:52:54.963 INFO:teuthology.orchestra.run.smithi100.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-01-24T21:52:54.963 INFO:teuthology.orchestra.run.smithi100.stdout:Recommended packages: 2023-01-24T21:52:54.963 INFO:teuthology.orchestra.run.smithi100.stdout: thermald 2023-01-24T21:52:54.975 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2023-01-24T21:52:54.975 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2023-01-24T21:52:55.017 INFO:teuthology.orchestra.run.smithi100.stdout:The following NEW packages will be installed: 2023-01-24T21:52:55.017 INFO:teuthology.orchestra.run.smithi100.stdout: linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-24T21:52:55.018 INFO:teuthology.orchestra.run.smithi100.stdout: linux-image-5.4.0-137-generic linux-modules-5.4.0-137-generic 2023-01-24T21:52:55.018 INFO:teuthology.orchestra.run.smithi100.stdout: linux-modules-extra-5.4.0-137-generic 2023-01-24T21:52:55.019 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages will be upgraded: 2023-01-24T21:52:55.019 INFO:teuthology.orchestra.run.smithi100.stdout: linux-generic linux-headers-generic linux-image-generic 2023-01-24T21:52:55.133 INFO:teuthology.orchestra.run.smithi149.stdout:The following additional packages will be installed: 2023-01-24T21:52:55.133 INFO:teuthology.orchestra.run.smithi149.stdout: linux-generic linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-24T21:52:55.134 INFO:teuthology.orchestra.run.smithi149.stdout: linux-headers-generic linux-image-5.4.0-137-generic 2023-01-24T21:52:55.134 INFO:teuthology.orchestra.run.smithi149.stdout: linux-modules-5.4.0-137-generic linux-modules-extra-5.4.0-137-generic 2023-01-24T21:52:55.135 INFO:teuthology.orchestra.run.smithi149.stdout:Suggested packages: 2023-01-24T21:52:55.135 INFO:teuthology.orchestra.run.smithi149.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-01-24T21:52:55.135 INFO:teuthology.orchestra.run.smithi149.stdout:Recommended packages: 2023-01-24T21:52:55.136 INFO:teuthology.orchestra.run.smithi149.stdout: thermald 2023-01-24T21:52:55.187 INFO:teuthology.orchestra.run.smithi149.stdout:The following NEW packages will be installed: 2023-01-24T21:52:55.188 INFO:teuthology.orchestra.run.smithi149.stdout: linux-headers-5.4.0-137 linux-headers-5.4.0-137-generic 2023-01-24T21:52:55.188 INFO:teuthology.orchestra.run.smithi149.stdout: linux-image-5.4.0-137-generic linux-modules-5.4.0-137-generic 2023-01-24T21:52:55.189 INFO:teuthology.orchestra.run.smithi149.stdout: linux-modules-extra-5.4.0-137-generic 2023-01-24T21:52:55.190 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages will be upgraded: 2023-01-24T21:52:55.190 INFO:teuthology.orchestra.run.smithi149.stdout: linux-generic linux-headers-generic linux-image-generic 2023-01-24T21:52:55.218 INFO:teuthology.orchestra.run.smithi100.stdout:3 upgraded, 5 newly installed, 0 to remove and 125 not upgraded. 2023-01-24T21:52:55.218 INFO:teuthology.orchestra.run.smithi100.stdout:Need to get 77.1 MB of archives. 2023-01-24T21:52:55.219 INFO:teuthology.orchestra.run.smithi100.stdout:After this operation, 380 MB of additional disk space will be used. 2023-01-24T21:52:55.219 INFO:teuthology.orchestra.run.smithi100.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-137-generic amd64 5.4.0-137.154 [15.0 MB] 2023-01-24T21:52:55.241 INFO:teuthology.orchestra.run.smithi149.stdout:3 upgraded, 5 newly installed, 0 to remove and 125 not upgraded. 2023-01-24T21:52:55.241 INFO:teuthology.orchestra.run.smithi149.stdout:Need to get 77.1 MB of archives. 2023-01-24T21:52:55.241 INFO:teuthology.orchestra.run.smithi149.stdout:After this operation, 380 MB of additional disk space will be used. 2023-01-24T21:52:55.242 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-137-generic amd64 5.4.0-137.154 [15.0 MB] 2023-01-24T21:52:55.574 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-137-generic amd64 5.4.0-137.154 [10.5 MB] 2023-01-24T21:52:55.665 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-137-generic amd64 5.4.0-137.154 [39.2 MB] 2023-01-24T21:52:56.120 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.137.135 [1,896 B] 2023-01-24T21:52:56.120 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.137.135 [2,528 B] 2023-01-24T21:52:56.121 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137 all 5.4.0-137.154 [11.0 MB] 2023-01-24T21:52:56.210 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137-generic amd64 5.4.0-137.154 [1,400 kB] 2023-01-24T21:52:56.221 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.137.135 [2,392 B] 2023-01-24T21:52:56.486 INFO:teuthology.orchestra.run.smithi100.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-137-generic amd64 5.4.0-137.154 [10.5 MB] 2023-01-24T21:52:56.785 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-137-generic amd64 5.4.0-137.154 [39.2 MB] 2023-01-24T21:52:56.935 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 77.1 MB in 1s (75.2 MB/s) 2023-01-24T21:52:57.136 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-modules-5.4.0-137-generic. 2023-01-24T21:52:58.201 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.137.135 [1,896 B] 2023-01-24T21:52:58.202 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.137.135 [2,528 B] 2023-01-24T21:52:58.202 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137 all 5.4.0-137.154 [11.0 MB] 2023-01-24T21:52:58.506 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-137-generic amd64 5.4.0-137.154 [1,400 kB] 2023-01-24T21:52:58.550 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.137.135 [2,392 B] 2023-01-24T21:52:58.876 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-01-24T21:52:58.881 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../0-linux-modules-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-24T21:52:58.965 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:52:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 77.1 MB in 4s (21.9 MB/s) 2023-01-24T21:52:59.373 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-modules-5.4.0-137-generic. 2023-01-24T21:53:00.949 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-image-5.4.0-137-generic. 2023-01-24T21:53:00.963 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../1-linux-image-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-24T21:53:01.055 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:01.125 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-01-24T21:53:01.130 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../0-linux-modules-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-24T21:53:01.212 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:02.077 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-137-generic. 2023-01-24T21:53:02.093 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-24T21:53:02.135 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:03.096 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-image-5.4.0-137-generic. 2023-01-24T21:53:03.110 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../1-linux-image-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-24T21:53:03.235 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:04.332 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-137-generic. 2023-01-24T21:53:04.348 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-24T21:53:04.389 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:06.754 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../3-linux-generic_5.4.0.137.135_amd64.deb ... 2023-01-24T21:53:06.881 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-24T21:53:07.234 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.137.135_amd64.deb ... 2023-01-24T21:53:07.368 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-image-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-24T21:53:07.688 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-headers-5.4.0-137. 2023-01-24T21:53:07.703 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../5-linux-headers-5.4.0-137_5.4.0-137.154_all.deb ... 2023-01-24T21:53:07.746 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-24T21:53:09.475 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../3-linux-generic_5.4.0.137.135_amd64.deb ... 2023-01-24T21:53:09.594 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-24T21:53:09.913 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.137.135_amd64.deb ... 2023-01-24T21:53:10.039 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-image-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-24T21:53:10.383 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-headers-5.4.0-137. 2023-01-24T21:53:10.400 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../5-linux-headers-5.4.0-137_5.4.0-137.154_all.deb ... 2023-01-24T21:53:10.441 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-24T21:53:13.527 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-headers-5.4.0-137-generic. 2023-01-24T21:53:13.550 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../6-linux-headers-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-24T21:53:13.602 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:15.818 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-headers-5.4.0-137-generic. 2023-01-24T21:53:15.840 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../6-linux-headers-5.4.0-137-generic_5.4.0-137.154_amd64.deb ... 2023-01-24T21:53:15.884 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:16.274 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.137.135_amd64.deb ... 2023-01-24T21:53:16.396 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-headers-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-24T21:53:16.718 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-24T21:53:16.859 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:18.061 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:18.187 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:18.698 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.137.135_amd64.deb ... 2023-01-24T21:53:18.820 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-headers-generic (5.4.0.137.135) over (5.4.0.124.125) ... 2023-01-24T21:53:19.171 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-headers-5.4.0-137 (5.4.0-137.154) ... 2023-01-24T21:53:19.300 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-modules-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:19.342 INFO:teuthology.orchestra.run.smithi149.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-137-generic 2023-01-24T21:53:19.343 INFO:teuthology.orchestra.run.smithi149.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-137-generic 2023-01-24T21:53:19.480 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:20.519 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-headers-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:20.645 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:20.690 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-image-generic (5.4.0.137.135) ... 2023-01-24T21:53:20.825 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-headers-generic (5.4.0.137.135) ... 2023-01-24T21:53:20.951 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-generic (5.4.0.137.135) ... 2023-01-24T21:53:21.061 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:21.154 INFO:teuthology.orchestra.run.smithi149.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-01-24T21:53:21.154 INFO:teuthology.orchestra.run.smithi149.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-137-generic 2023-01-24T21:53:21.797 INFO:teuthology.orchestra.run.smithi100.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-137-generic 2023-01-24T21:53:21.798 INFO:teuthology.orchestra.run.smithi100.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-137-generic 2023-01-24T21:53:21.939 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-modules-extra-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:23.716 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-image-generic (5.4.0.137.135) ... 2023-01-24T21:53:23.842 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-headers-generic (5.4.0.137.135) ... 2023-01-24T21:53:23.951 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-generic (5.4.0.137.135) ... 2023-01-24T21:53:24.078 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for linux-image-5.4.0-137-generic (5.4.0-137.154) ... 2023-01-24T21:53:24.153 INFO:teuthology.orchestra.run.smithi100.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-01-24T21:53:24.153 INFO:teuthology.orchestra.run.smithi100.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-137-generic 2023-01-24T21:53:42.989 INFO:teuthology.orchestra.run.smithi149.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-01-24T21:53:42.990 INFO:teuthology.orchestra.run.smithi149.stdout:Sourcing file `/etc/default/grub' 2023-01-24T21:53:43.011 INFO:teuthology.orchestra.run.smithi149.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-24T21:53:43.021 INFO:teuthology.orchestra.run.smithi149.stdout:Generating grub configuration file ... 2023-01-24T21:53:43.339 INFO:teuthology.orchestra.run.smithi149.stdout:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-24T21:53:43.366 INFO:teuthology.orchestra.run.smithi149.stdout:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-24T21:53:43.730 INFO:teuthology.orchestra.run.smithi149.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-24T21:53:43.741 INFO:teuthology.orchestra.run.smithi149.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-24T21:53:45.858 INFO:teuthology.orchestra.run.smithi100.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-01-24T21:53:45.858 INFO:teuthology.orchestra.run.smithi100.stdout:Sourcing file `/etc/default/grub' 2023-01-24T21:53:45.872 INFO:teuthology.orchestra.run.smithi100.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-24T21:53:45.898 INFO:teuthology.orchestra.run.smithi100.stdout:Generating grub configuration file ... 2023-01-24T21:53:46.254 INFO:teuthology.orchestra.run.smithi100.stdout:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-24T21:53:46.277 INFO:teuthology.orchestra.run.smithi100.stdout:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-24T21:53:46.443 INFO:teuthology.orchestra.run.smithi149.stdout:done 2023-01-24T21:53:46.660 INFO:teuthology.orchestra.run.smithi100.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-24T21:53:46.671 INFO:teuthology.orchestra.run.smithi100.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-24T21:53:46.838 DEBUG:teuthology.orchestra.run.smithi149:> dpkg -s linux-image-generic 2023-01-24T21:53:46.884 INFO:teuthology.orchestra.run.smithi149.stdout:Package: linux-image-generic 2023-01-24T21:53:46.885 INFO:teuthology.orchestra.run.smithi149.stdout:Status: install ok installed 2023-01-24T21:53:46.885 INFO:teuthology.orchestra.run.smithi149.stdout:Priority: optional 2023-01-24T21:53:46.886 INFO:teuthology.orchestra.run.smithi149.stdout:Section: kernel 2023-01-24T21:53:46.886 INFO:teuthology.orchestra.run.smithi149.stdout:Installed-Size: 19 2023-01-24T21:53:46.887 INFO:teuthology.orchestra.run.smithi149.stdout:Maintainer: Ubuntu Kernel Team 2023-01-24T21:53:46.888 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: amd64 2023-01-24T21:53:46.888 INFO:teuthology.orchestra.run.smithi149.stdout:Source: linux-meta 2023-01-24T21:53:46.888 INFO:teuthology.orchestra.run.smithi149.stdout:Version: 5.4.0.137.135 2023-01-24T21:53:46.888 INFO:teuthology.orchestra.run.smithi149.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-24T21:53:46.889 INFO:teuthology.orchestra.run.smithi149.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-24T21:53:46.889 INFO:teuthology.orchestra.run.smithi149.stdout:Recommends: thermald 2023-01-24T21:53:46.889 INFO:teuthology.orchestra.run.smithi149.stdout:Description: Generic Linux kernel image 2023-01-24T21:53:46.889 INFO:teuthology.orchestra.run.smithi149.stdout: This package will always depend on the latest generic kernel image 2023-01-24T21:53:46.890 INFO:teuthology.orchestra.run.smithi149.stdout: available. 2023-01-24T21:53:46.890 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-137-generic 2023-01-24T21:53:46.890 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-24T21:53:46.891 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-24T21:53:46.891 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-01-24T21:53:46.891 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=None, version=distro) 2023-01-24T21:53:46.891 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get clean 2023-01-24T21:53:46.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get update 2023-01-24T21:53:47.096 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-24T21:53:47.102 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-24T21:53:47.119 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-24T21:53:47.233 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-01-24T21:53:47.767 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [11.7 kB] 2023-01-24T21:53:47.876 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [16.9 kB] 2023-01-24T21:53:49.352 INFO:teuthology.orchestra.run.smithi100.stdout:done 2023-01-24T21:53:49.498 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 142 kB in 1s (166 kB/s) 2023-01-24T21:53:49.788 DEBUG:teuthology.orchestra.run.smithi100:> dpkg -s linux-image-generic 2023-01-24T21:53:49.835 INFO:teuthology.orchestra.run.smithi100.stdout:Package: linux-image-generic 2023-01-24T21:53:49.835 INFO:teuthology.orchestra.run.smithi100.stdout:Status: install ok installed 2023-01-24T21:53:49.836 INFO:teuthology.orchestra.run.smithi100.stdout:Priority: optional 2023-01-24T21:53:49.836 INFO:teuthology.orchestra.run.smithi100.stdout:Section: kernel 2023-01-24T21:53:49.836 INFO:teuthology.orchestra.run.smithi100.stdout:Installed-Size: 19 2023-01-24T21:53:49.836 INFO:teuthology.orchestra.run.smithi100.stdout:Maintainer: Ubuntu Kernel Team 2023-01-24T21:53:49.836 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: amd64 2023-01-24T21:53:49.837 INFO:teuthology.orchestra.run.smithi100.stdout:Source: linux-meta 2023-01-24T21:53:49.837 INFO:teuthology.orchestra.run.smithi100.stdout:Version: 5.4.0.137.135 2023-01-24T21:53:49.837 INFO:teuthology.orchestra.run.smithi100.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-24T21:53:49.837 INFO:teuthology.orchestra.run.smithi100.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-24T21:53:49.838 INFO:teuthology.orchestra.run.smithi100.stdout:Recommends: thermald 2023-01-24T21:53:49.838 INFO:teuthology.orchestra.run.smithi100.stdout:Description: Generic Linux kernel image 2023-01-24T21:53:49.838 INFO:teuthology.orchestra.run.smithi100.stdout: This package will always depend on the latest generic kernel image 2023-01-24T21:53:49.838 INFO:teuthology.orchestra.run.smithi100.stdout: available. 2023-01-24T21:53:49.838 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-137-generic 2023-01-24T21:53:49.839 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-24T21:53:49.839 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-24T21:53:49.839 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-01-24T21:53:49.839 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=None, version=distro) 2023-01-24T21:53:49.840 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get clean 2023-01-24T21:53:49.965 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get update 2023-01-24T21:53:50.252 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-24T21:53:50.252 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-24T21:53:50.331 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-01-24T21:53:50.439 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-01-24T21:53:50.461 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-24T21:53:50.530 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-01-24T21:53:50.716 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-01-24T21:53:50.721 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2023-01-24T21:53:50.722 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2023-01-24T21:53:50.873 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,349 kB] 2023-01-24T21:53:50.911 INFO:teuthology.orchestra.run.smithi149.stdout:linux-image-generic is already the newest version (5.4.0.137.135). 2023-01-24T21:53:50.912 INFO:teuthology.orchestra.run.smithi149.stdout:0 upgraded, 0 newly installed, 0 to remove and 125 not upgraded. 2023-01-24T21:53:50.913 DEBUG:teuthology.orchestra.run.smithi149:> dpkg -s linux-image-generic 2023-01-24T21:53:50.936 INFO:teuthology.orchestra.run.smithi149.stdout:Package: linux-image-generic 2023-01-24T21:53:50.937 INFO:teuthology.orchestra.run.smithi149.stdout:Status: install ok installed 2023-01-24T21:53:50.937 INFO:teuthology.orchestra.run.smithi149.stdout:Priority: optional 2023-01-24T21:53:50.937 INFO:teuthology.orchestra.run.smithi149.stdout:Section: kernel 2023-01-24T21:53:50.937 INFO:teuthology.orchestra.run.smithi149.stdout:Installed-Size: 19 2023-01-24T21:53:50.937 INFO:teuthology.orchestra.run.smithi149.stdout:Maintainer: Ubuntu Kernel Team 2023-01-24T21:53:50.938 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: amd64 2023-01-24T21:53:50.938 INFO:teuthology.orchestra.run.smithi149.stdout:Source: linux-meta 2023-01-24T21:53:50.938 INFO:teuthology.orchestra.run.smithi149.stdout:Version: 5.4.0.137.135 2023-01-24T21:53:50.938 INFO:teuthology.orchestra.run.smithi149.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-24T21:53:50.938 INFO:teuthology.orchestra.run.smithi149.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-24T21:53:50.939 INFO:teuthology.orchestra.run.smithi149.stdout:Recommends: thermald 2023-01-24T21:53:50.939 INFO:teuthology.orchestra.run.smithi149.stdout:Description: Generic Linux kernel image 2023-01-24T21:53:50.939 INFO:teuthology.orchestra.run.smithi149.stdout: This package will always depend on the latest generic kernel image 2023-01-24T21:53:50.939 INFO:teuthology.orchestra.run.smithi149.stdout: available. 2023-01-24T21:53:50.940 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2023-01-24T21:53:50.946 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.DACavmVWXA 2023-01-24T21:53:50.946 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub/grub.cfg /tmp/tmp.DACavmVWXA 2023-01-24T21:53:51.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.DACavmVWXA 2023-01-24T21:53:51.067 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.DACavmVWXA is 9KB 2023-01-24T21:53:51.082 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.DACavmVWXA 2023-01-24T21:53:51.088 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-01-24T21:53:51.146 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T21:53:51.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-01-24T21:53:51.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-01-24T21:53:51.177 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-137-generic 2023-01-24T21:53:51.178 DEBUG:teuthology.orchestra.run.smithi149:> sudo update-grub 2023-01-24T21:53:51.282 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [775 kB] 2023-01-24T21:53:51.309 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [708 kB] 2023-01-24T21:53:51.334 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,018 kB] 2023-01-24T21:53:51.936 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 5,072 kB in 2s (2,877 kB/s) 2023-01-24T21:53:52.496 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub' 2023-01-24T21:53:52.501 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-24T21:53:52.515 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2023-01-24T21:53:52.771 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-24T21:53:52.785 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-24T21:53:52.877 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-01-24T21:53:52.902 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-01-24T21:53:52.966 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-01-24T21:53:53.136 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-24T21:53:53.146 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-24T21:53:53.153 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2023-01-24T21:53:53.154 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2023-01-24T21:53:53.354 INFO:teuthology.orchestra.run.smithi100.stdout:linux-image-generic is already the newest version (5.4.0.137.135). 2023-01-24T21:53:53.354 INFO:teuthology.orchestra.run.smithi100.stdout:0 upgraded, 0 newly installed, 0 to remove and 125 not upgraded. 2023-01-24T21:53:53.356 DEBUG:teuthology.orchestra.run.smithi100:> dpkg -s linux-image-generic 2023-01-24T21:53:53.377 INFO:teuthology.orchestra.run.smithi100.stdout:Package: linux-image-generic 2023-01-24T21:53:53.377 INFO:teuthology.orchestra.run.smithi100.stdout:Status: install ok installed 2023-01-24T21:53:53.378 INFO:teuthology.orchestra.run.smithi100.stdout:Priority: optional 2023-01-24T21:53:53.378 INFO:teuthology.orchestra.run.smithi100.stdout:Section: kernel 2023-01-24T21:53:53.378 INFO:teuthology.orchestra.run.smithi100.stdout:Installed-Size: 19 2023-01-24T21:53:53.378 INFO:teuthology.orchestra.run.smithi100.stdout:Maintainer: Ubuntu Kernel Team 2023-01-24T21:53:53.378 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: amd64 2023-01-24T21:53:53.379 INFO:teuthology.orchestra.run.smithi100.stdout:Source: linux-meta 2023-01-24T21:53:53.379 INFO:teuthology.orchestra.run.smithi100.stdout:Version: 5.4.0.137.135 2023-01-24T21:53:53.379 INFO:teuthology.orchestra.run.smithi100.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-01-24T21:53:53.379 INFO:teuthology.orchestra.run.smithi100.stdout:Depends: linux-image-5.4.0-137-generic, linux-modules-extra-5.4.0-137-generic, linux-firmware, intel-microcode, amd64-microcode 2023-01-24T21:53:53.379 INFO:teuthology.orchestra.run.smithi100.stdout:Recommends: thermald 2023-01-24T21:53:53.380 INFO:teuthology.orchestra.run.smithi100.stdout:Description: Generic Linux kernel image 2023-01-24T21:53:53.380 INFO:teuthology.orchestra.run.smithi100.stdout: This package will always depend on the latest generic kernel image 2023-01-24T21:53:53.380 INFO:teuthology.orchestra.run.smithi100.stdout: available. 2023-01-24T21:53:53.381 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2023-01-24T21:53:53.387 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.khA2nKSy65 2023-01-24T21:53:53.387 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub/grub.cfg /tmp/tmp.khA2nKSy65 2023-01-24T21:53:53.401 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.khA2nKSy65 2023-01-24T21:53:53.487 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.khA2nKSy65 is 9KB 2023-01-24T21:53:53.503 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.khA2nKSy65 2023-01-24T21:53:53.510 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-01-24T21:53:53.568 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T21:53:53.569 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-01-24T21:53:53.569 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-01-24T21:53:53.605 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-137-generic 2023-01-24T21:53:53.605 DEBUG:teuthology.orchestra.run.smithi100:> sudo update-grub 2023-01-24T21:53:54.810 INFO:teuthology.orchestra.run.smithi149.stderr:done 2023-01-24T21:53:54.812 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2023-01-24T21:53:55.071 INFO:teuthology.orchestra.run.smithi100.stderr:Sourcing file `/etc/default/grub' 2023-01-24T21:53:55.076 INFO:teuthology.orchestra.run.smithi100.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-01-24T21:53:55.088 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2023-01-24T21:53:55.354 INFO:teuthology.orchestra.run.smithi100.stderr:Found linux image: /boot/vmlinuz-5.4.0-137-generic 2023-01-24T21:53:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:Found initrd image: /boot/initrd.img-5.4.0-137-generic 2023-01-24T21:53:55.716 INFO:teuthology.orchestra.run.smithi100.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-01-24T21:53:55.728 INFO:teuthology.orchestra.run.smithi100.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-01-24T21:53:57.460 INFO:teuthology.orchestra.run.smithi100.stderr:done 2023-01-24T21:53:57.461 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2023-01-24T21:54:24.840 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-01-24T21:54:24.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-01-24T21:54:24.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-24T21:54:27.464 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-01-24T21:54:27.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-01-24T21:54:27.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-24T21:54:43.176 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-01-24T21:54:45.993 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-01-24T21:55:13.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-01-24T21:55:13.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-24T21:55:15.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-01-24T21:55:15.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-24T21:55:31.564 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-01-24T21:55:34.377 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-01-24T21:56:01.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-01-24T21:56:01.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-24T21:56:01.809 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-01-24T21:56:02.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-01-24T21:56:02.355 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-137-generic"... 2023-01-24T21:56:02.355 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2023-01-24T21:56:02.362 INFO:teuthology.orchestra.run.smithi149.stdout:5.4.0-137-generic 2023-01-24T21:56:02.362 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-137-generic vs 5.4.0-137-generic 2023-01-24T21:56:02.364 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-24T21:56:02.364 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-01-24T21:56:03.365 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-01-24T21:56:03.366 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-24T21:56:03.449 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2023-01-24T21:56:03.478 DEBUG:teuthology.parallel:result is None 2023-01-24T21:56:04.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-01-24T21:56:04.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-24T21:56:04.586 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-01-24T21:56:05.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-01-24T21:56:05.174 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-137-generic"... 2023-01-24T21:56:05.175 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2023-01-24T21:56:05.183 INFO:teuthology.orchestra.run.smithi100.stdout:5.4.0-137-generic 2023-01-24T21:56:05.183 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-137-generic vs 5.4.0-137-generic 2023-01-24T21:56:05.183 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-24T21:56:05.184 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-01-24T21:56:06.185 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-01-24T21:56:06.185 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-24T21:56:06.280 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2023-01-24T21:56:06.302 DEBUG:teuthology.parallel:result is None 2023-01-24T21:56:06.302 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-24T21:56:06.312 INFO:teuthology.task.internal:Creating test directory... 2023-01-24T21:56:06.313 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-24T21:56:06.317 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-24T21:56:06.326 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-24T21:56:06.334 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-24T21:56:06.349 INFO:teuthology.task.internal:Creating archive directory... 2023-01-24T21:56:06.350 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-24T21:56:06.368 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-24T21:56:06.393 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-24T21:56:06.402 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-24T21:56:06.403 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-24T21:56:06.406 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-24T21:56:06.426 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-24T21:56:06.436 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-24T21:56:06.453 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-24T21:56:06.464 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-24T21:56:06.465 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-24T21:56:06.473 INFO:teuthology.task.internal:Configuring sudo... 2023-01-24T21:56:06.473 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-24T21:56:06.481 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-24T21:56:06.496 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-24T21:56:06.510 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-24T21:56:06.510 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-24T21:56:06.514 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-24T21:56:06.522 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-24T21:56:06.566 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-24T21:56:06.574 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T21:56:06.575 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-24T21:56:06.591 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-24T21:56:06.602 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-24T21:56:06.609 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T21:56:06.610 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-24T21:56:06.679 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2023-01-24T21:56:06.683 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2023-01-24T21:56:06.733 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-24T21:56:06.745 INFO:teuthology.task.internal:Starting timer... 2023-01-24T21:56:06.746 INFO:teuthology.run_tasks:Running task pcp... 2023-01-24T21:56:06.762 INFO:teuthology.run_tasks:Running task selinux... 2023-01-24T21:56:06.776 DEBUG:teuthology.task.selinux:Excluding smithi100: OS 'ubuntu' does not support SELinux 2023-01-24T21:56:06.777 DEBUG:teuthology.task.selinux:Excluding smithi149: OS 'ubuntu' does not support SELinux 2023-01-24T21:56:06.777 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-24T21:56:06.778 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-01-24T21:56:06.778 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-24T21:56:06.779 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-24T21:56:06.790 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-01-24T21:56:06.792 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-24T21:56:06.811 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-24T21:56:06.812 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-24T22:01:13.136 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2023-01-24T22:01:13.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-01-24T22:01:13.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-24T22:01:13.191 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-01-24T22:01:13.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-01-24T22:01:13.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-24T22:01:13.367 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-01-24T22:01:13.486 INFO:teuthology.run_tasks:Running task clock... 2023-01-24T22:01:13.500 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-24T22:01:13.501 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-24T22:01:13.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-24T22:01:13.505 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-24T22:01:13.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-24T22:01:13.536 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:13 ntpd[19455]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-01-24T22:01:13.536 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:13 ntpd[19455]: Command line: ntpd -gq 2023-01-24T22:01:13.537 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:13 ntpd[19455]: proto: precision = 0.117 usec (-23) 2023-01-24T22:01:13.538 INFO:teuthology.orchestra.run.smithi100.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-24T22:01:13.538 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:13 ntpd[19455]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-24T22:01:13.539 INFO:teuthology.orchestra.run.smithi100.stderr:restrict ::: KOD does nothing without LIMITED. 2023-01-24T22:01:13.541 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:13 ntpd[19455]: restrict ::: KOD does nothing without LIMITED. 2023-01-24T22:01:13.541 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:13 ntpd[19455]: Listen and drop on 0 v6wildcard [::]:123 2023-01-24T22:01:13.541 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:13 ntpd[19455]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-01-24T22:01:13.542 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:13 ntpd[19455]: Listen normally on 2 lo 127.0.0.1:123 2023-01-24T22:01:13.542 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:13 ntpd[19455]: Listen normally on 3 enp3s0f1 172.21.15.100:123 2023-01-24T22:01:13.542 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:13 ntpd[19455]: Listen normally on 4 lo [::1]:123 2023-01-24T22:01:13.543 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:13 ntpd[19455]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d733%5]:123 2023-01-24T22:01:13.543 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:13 ntpd[19455]: Listening on routing socket on fd #22 for interface updates 2023-01-24T22:01:13.544 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:13 ntpd[19420]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-01-24T22:01:13.547 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:13 ntpd[19420]: Command line: ntpd -gq 2023-01-24T22:01:13.548 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:13 ntpd[19420]: proto: precision = 0.063 usec (-24) 2023-01-24T22:01:13.548 INFO:teuthology.orchestra.run.smithi149.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-24T22:01:13.549 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:13 ntpd[19420]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-01-24T22:01:13.549 INFO:teuthology.orchestra.run.smithi149.stderr:restrict ::: KOD does nothing without LIMITED. 2023-01-24T22:01:13.551 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:13 ntpd[19420]: restrict ::: KOD does nothing without LIMITED. 2023-01-24T22:01:13.551 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:13 ntpd[19420]: Listen and drop on 0 v6wildcard [::]:123 2023-01-24T22:01:13.551 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:13 ntpd[19420]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-01-24T22:01:13.551 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:13 ntpd[19420]: Listen normally on 2 lo 127.0.0.1:123 2023-01-24T22:01:13.551 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:13 ntpd[19420]: Listen normally on 3 enp3s0f1 172.21.15.149:123 2023-01-24T22:01:13.552 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:13 ntpd[19420]: Listen normally on 4 lo [::1]:123 2023-01-24T22:01:13.552 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:13 ntpd[19420]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7d57%5]:123 2023-01-24T22:01:13.552 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:13 ntpd[19420]: Listening on routing socket on fd #22 for interface updates 2023-01-24T22:01:14.536 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:14 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:14.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:14 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:14.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:14 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:14.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:14 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:14.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:14 ntpd[19455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:14.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:14 ntpd[19455]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:14.542 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:14.543 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:14.543 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:14.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:14.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:14.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:14.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:14.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:14.545 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:14.545 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:14.545 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:14.545 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:14.545 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:14.546 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:14.546 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:14.546 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:14.546 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:14.547 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:14.547 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:14.547 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:14 ntpd[19420]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:15.536 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:15 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:15.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:15 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:15.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:15 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:15.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:15 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:15.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:15 ntpd[19455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:15 ntpd[19455]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:16.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:16 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:16.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:16 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:16.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:16 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:16.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:16 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:16.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:16 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:16.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:16 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:16.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:16 ntpd[19455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:16.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:16 ntpd[19455]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:16.543 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:16.543 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:16.543 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:16.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:16.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:16.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:16.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:16.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:16.545 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:16.545 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:16.545 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:16.545 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:16.545 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:16.546 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:16.546 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:16.546 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:16.546 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:16.546 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:16 ntpd[19420]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:17.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:17 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:17.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:17 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:17.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:17 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:17.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:17 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:17.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:17 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:17.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:17 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:17.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:17 ntpd[19455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:17.539 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:17 ntpd[19455]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:17.539 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:17 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:17.539 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:17 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:17.539 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:17 ntpd[19455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:17.539 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:17 ntpd[19455]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:18.536 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:18 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:18 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:18 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:18 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:18 ntpd[19455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:18.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:18 ntpd[19455]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:18.542 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:18.543 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:18.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:18.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:18.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:18.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:18.545 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:18.548 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:18.548 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:18.549 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:18.549 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:18.549 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:18.549 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:18.549 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:18.550 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:18.550 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:18.550 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:18.550 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:18 ntpd[19420]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:19.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:19 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:19.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:19 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:19.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:19 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:19.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:19 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:19.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:19 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:19.538 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:19 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:19.539 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:19 ntpd[19455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:19.539 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:19 ntpd[19455]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:19.539 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:19 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:19.539 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:19 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:19.540 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:19 ntpd[19455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:19.540 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:19 ntpd[19455]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:20 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:20.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:20 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:20.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:20 ntpd[19455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:20.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:20 ntpd[19455]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:20.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:20 ntpd[19455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:20.537 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:20 ntpd[19455]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:20.538 INFO:teuthology.orchestra.run.smithi100.stdout:24 Jan 22:01:20 ntpd[19455]: ntpd: time slew -0.002681 s 2023-01-24T22:01:20.538 INFO:teuthology.orchestra.run.smithi100.stdout:ntpd: time slew -0.002681s 2023-01-24T22:01:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:20 ntpd[19455]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-01-24T22:01:20.539 INFO:teuthology.orchestra.run.smithi100.stderr:24 Jan 22:01:20 ntpd[19455]: can't open /var/log/ntpstats/loopstats.20230124: Permission denied 2023-01-24T22:01:20.542 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:20 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:20.542 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:20 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:20.543 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:20 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:20.543 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:20 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:20.543 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:20 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:20.543 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:20 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:20.543 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:20 ntpd[19420]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-01-24T22:01:20.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:20 ntpd[19420]: can't open /var/log/ntpstats/rawstats.20230124: Permission denied 2023-01-24T22:01:20.544 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:20 ntpd[19420]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-01-24T22:01:20.545 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:20 ntpd[19420]: can't open /var/log/ntpstats/peerstats.20230124: Permission denied 2023-01-24T22:01:20.545 INFO:teuthology.orchestra.run.smithi149.stdout:24 Jan 22:01:20 ntpd[19420]: ntpd: time slew +0.001064 s 2023-01-24T22:01:20.546 INFO:teuthology.orchestra.run.smithi149.stdout:ntpd: time slew +0.001064s 2023-01-24T22:01:20.546 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:20 ntpd[19420]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-01-24T22:01:20.546 INFO:teuthology.orchestra.run.smithi149.stderr:24 Jan 22:01:20 ntpd[19420]: can't open /var/log/ntpstats/loopstats.20230124: Permission denied 2023-01-24T22:01:20.606 INFO:teuthology.orchestra.run.smithi100.stdout: remote refid st t when poll reach delay offset jitter 2023-01-24T22:01:20.607 INFO:teuthology.orchestra.run.smithi100.stdout:============================================================================== 2023-01-24T22:01:20.607 INFO:teuthology.orchestra.run.smithi100.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-24T22:01:20.607 INFO:teuthology.orchestra.run.smithi100.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-24T22:01:20.608 INFO:teuthology.orchestra.run.smithi100.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-24T22:01:20.608 INFO:teuthology.orchestra.run.smithi100.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-24T22:01:20.624 INFO:teuthology.orchestra.run.smithi149.stdout: remote refid st t when poll reach delay offset jitter 2023-01-24T22:01:20.625 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================== 2023-01-24T22:01:20.625 INFO:teuthology.orchestra.run.smithi149.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-24T22:01:20.625 INFO:teuthology.orchestra.run.smithi149.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-24T22:01:20.626 INFO:teuthology.orchestra.run.smithi149.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-24T22:01:20.626 INFO:teuthology.orchestra.run.smithi149.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-01-24T22:01:20.627 INFO:teuthology.run_tasks:Running task install... 2023-01-24T22:01:20.642 DEBUG:teuthology.task.install:project ceph 2023-01-24T22:01:20.643 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'}} 2023-01-24T22:01:20.643 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'} 2023-01-24T22:01:20.643 INFO:teuthology.task.install:Using flavor: default 2023-01-24T22:01:20.655 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-24T22:01:20.656 INFO:teuthology.task.install:extra packages: [] 2023-01-24T22:01:20.657 DEBUG:teuthology.orchestra.run.smithi100:> sudo lsb_release -is 2023-01-24T22:01:20.709 INFO:teuthology.orchestra.run.smithi100.stdout:Ubuntu 2023-01-24T22:01:20.718 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-24T22:01:20.718 DEBUG:teuthology.orchestra.run.smithi149:> sudo lsb_release -is 2023-01-24T22:01:20.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-key list | grep Ceph 2023-01-24T22:01:20.769 INFO:teuthology.orchestra.run.smithi149.stdout:Ubuntu 2023-01-24T22:01:20.775 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-24T22:01:20.775 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-key list | grep Ceph 2023-01-24T22:01:20.816 INFO:teuthology.orchestra.run.smithi100.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-01-24T22:01:20.873 INFO:teuthology.orchestra.run.smithi100.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-01-24T22:01:20.873 INFO:teuthology.orchestra.run.smithi100.stdout:uid [ unknown] Ceph.com (release key) 2023-01-24T22:01:20.874 DEBUG:teuthology.orchestra.run.smithi100:> sudo lsb_release -is 2023-01-24T22:01:20.885 INFO:teuthology.orchestra.run.smithi149.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-01-24T22:01:20.928 INFO:teuthology.orchestra.run.smithi100.stdout:Ubuntu 2023-01-24T22:01:20.932 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-24T22:01:20.933 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-01-24T22:01:20.933 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=49f8fb05584886826e8eade75f7105fba754560c 2023-01-24T22:01:20.945 INFO:teuthology.orchestra.run.smithi149.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-01-24T22:01:20.946 INFO:teuthology.orchestra.run.smithi149.stdout:uid [ unknown] Ceph.com (release key) 2023-01-24T22:01:20.947 DEBUG:teuthology.orchestra.run.smithi149:> sudo lsb_release -is 2023-01-24T22:01:20.994 INFO:teuthology.orchestra.run.smithi149.stdout:Ubuntu 2023-01-24T22:01:20.999 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-24T22:01:21.000 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-01-24T22:01:21.000 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=49f8fb05584886826e8eade75f7105fba754560c 2023-01-24T22:01:21.092 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default/ 2023-01-24T22:01:21.092 INFO:teuthology.task.install.deb:Package version is 17.2.5-727-g49f8fb05-1focal 2023-01-24T22:01:21.153 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default/ 2023-01-24T22:01:21.154 INFO:teuthology.task.install.deb:Package version is 17.2.5-727-g49f8fb05-1focal 2023-01-24T22:01:21.234 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:01:21.234 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-01-24T22:01:21.250 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get update 2023-01-24T22:01:21.278 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:01:21.278 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-01-24T22:01:21.295 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get update 2023-01-24T22:01:21.431 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-24T22:01:21.436 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-24T22:01:21.453 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-24T22:01:21.479 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-24T22:01:21.493 INFO:teuthology.orchestra.run.smithi100.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal InRelease 2023-01-24T22:01:21.516 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-01-24T22:01:21.542 INFO:teuthology.orchestra.run.smithi149.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal InRelease 2023-01-24T22:01:21.542 INFO:teuthology.orchestra.run.smithi100.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal Release.gpg 2023-01-24T22:01:21.563 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-01-24T22:01:21.565 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main i386 Packages [3,372 B] 2023-01-24T22:01:21.588 INFO:teuthology.orchestra.run.smithi149.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal Release.gpg 2023-01-24T22:01:21.594 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:8 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-01-24T22:01:21.611 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main i386 Packages [3,372 B] 2023-01-24T22:01:21.617 INFO:teuthology.orchestra.run.smithi100.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-01-24T22:01:21.637 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal InRelease 2023-01-24T22:01:21.660 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-01-24T22:01:21.707 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-01-24T22:01:21.799 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-01-24T22:01:22.090 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 28.4 kB in 1s (44.5 kB/s) 2023-01-24T22:01:22.137 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 28.4 kB in 1s (44.6 kB/s) 2023-01-24T22:01:23.026 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-01-24T22:01:23.048 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.5-727-g49f8fb05-1focal cephadm=17.2.5-727-g49f8fb05-1focal ceph-mds=17.2.5-727-g49f8fb05-1focal ceph-mgr=17.2.5-727-g49f8fb05-1focal ceph-common=17.2.5-727-g49f8fb05-1focal ceph-fuse=17.2.5-727-g49f8fb05-1focal ceph-test=17.2.5-727-g49f8fb05-1focal ceph-volume=17.2.5-727-g49f8fb05-1focal radosgw=17.2.5-727-g49f8fb05-1focal python3-rados=17.2.5-727-g49f8fb05-1focal python3-rgw=17.2.5-727-g49f8fb05-1focal python3-cephfs=17.2.5-727-g49f8fb05-1focal python3-rbd=17.2.5-727-g49f8fb05-1focal libcephfs2=17.2.5-727-g49f8fb05-1focal libcephfs-dev=17.2.5-727-g49f8fb05-1focal librados2=17.2.5-727-g49f8fb05-1focal librbd1=17.2.5-727-g49f8fb05-1focal rbd-fuse=17.2.5-727-g49f8fb05-1focal 2023-01-24T22:01:23.082 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-01-24T22:01:23.105 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.5-727-g49f8fb05-1focal cephadm=17.2.5-727-g49f8fb05-1focal ceph-mds=17.2.5-727-g49f8fb05-1focal ceph-mgr=17.2.5-727-g49f8fb05-1focal ceph-common=17.2.5-727-g49f8fb05-1focal ceph-fuse=17.2.5-727-g49f8fb05-1focal ceph-test=17.2.5-727-g49f8fb05-1focal ceph-volume=17.2.5-727-g49f8fb05-1focal radosgw=17.2.5-727-g49f8fb05-1focal python3-rados=17.2.5-727-g49f8fb05-1focal python3-rgw=17.2.5-727-g49f8fb05-1focal python3-cephfs=17.2.5-727-g49f8fb05-1focal python3-rbd=17.2.5-727-g49f8fb05-1focal libcephfs2=17.2.5-727-g49f8fb05-1focal libcephfs-dev=17.2.5-727-g49f8fb05-1focal librados2=17.2.5-727-g49f8fb05-1focal librbd1=17.2.5-727-g49f8fb05-1focal rbd-fuse=17.2.5-727-g49f8fb05-1focal 2023-01-24T22:01:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-01-24T22:01:23.174 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2023-01-24T22:01:23.299 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2023-01-24T22:01:23.300 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2023-01-24T22:01:23.342 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2023-01-24T22:01:23.343 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2023-01-24T22:01:23.458 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages were automatically installed and are no longer required: 2023-01-24T22:01:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-01-24T22:01:23.459 INFO:teuthology.orchestra.run.smithi100.stdout:Use 'sudo apt autoremove' to remove them. 2023-01-24T22:01:23.460 INFO:teuthology.orchestra.run.smithi100.stdout:The following additional packages will be installed: 2023-01-24T22:01:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-01-24T22:01:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-01-24T22:01:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-01-24T22:01:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-01-24T22:01:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-01-24T22:01:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-01-24T22:01:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-01-24T22:01:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-01-24T22:01:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 2023-01-24T22:01:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-01-24T22:01:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-01-24T22:01:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-01-24T22:01:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-01-24T22:01:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-01-24T22:01:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-01-24T22:01:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2023-01-24T22:01:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2023-01-24T22:01:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-01-24T22:01:23.467 INFO:teuthology.orchestra.run.smithi100.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-01-24T22:01:23.467 INFO:teuthology.orchestra.run.smithi100.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2023-01-24T22:01:23.467 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket python3-webtest python3-werkzeug qttranslations5-l10n 2023-01-24T22:01:23.467 INFO:teuthology.orchestra.run.smithi100.stdout: socat xmlstarlet 2023-01-24T22:01:23.468 INFO:teuthology.orchestra.run.smithi100.stdout:Suggested packages: 2023-01-24T22:01:23.468 INFO:teuthology.orchestra.run.smithi100.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-01-24T22:01:23.468 INFO:teuthology.orchestra.run.smithi100.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-01-24T22:01:23.468 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-01-24T22:01:23.468 INFO:teuthology.orchestra.run.smithi100.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-01-24T22:01:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-01-24T22:01:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-01-24T22:01:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-01-24T22:01:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-01-24T22:01:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-01-24T22:01:23.470 INFO:teuthology.orchestra.run.smithi100.stdout:Recommended packages: 2023-01-24T22:01:23.470 INFO:teuthology.orchestra.run.smithi100.stdout: btrfs-tools 2023-01-24T22:01:23.499 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages were automatically installed and are no longer required: 2023-01-24T22:01:23.500 INFO:teuthology.orchestra.run.smithi149.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-01-24T22:01:23.501 INFO:teuthology.orchestra.run.smithi149.stdout:Use 'sudo apt autoremove' to remove them. 2023-01-24T22:01:23.501 INFO:teuthology.orchestra.run.smithi149.stdout:The following additional packages will be installed: 2023-01-24T22:01:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-01-24T22:01:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-01-24T22:01:23.501 INFO:teuthology.orchestra.run.smithi149.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-01-24T22:01:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-01-24T22:01:23.502 INFO:teuthology.orchestra.run.smithi149.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-01-24T22:01:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-01-24T22:01:23.503 INFO:teuthology.orchestra.run.smithi149.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-01-24T22:01:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-01-24T22:01:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 2023-01-24T22:01:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-01-24T22:01:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-01-24T22:01:23.504 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-01-24T22:01:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-01-24T22:01:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-01-24T22:01:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-01-24T22:01:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2023-01-24T22:01:23.505 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2023-01-24T22:01:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-01-24T22:01:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-01-24T22:01:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2023-01-24T22:01:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket python3-webtest python3-werkzeug qttranslations5-l10n 2023-01-24T22:01:23.506 INFO:teuthology.orchestra.run.smithi149.stdout: socat xmlstarlet 2023-01-24T22:01:23.507 INFO:teuthology.orchestra.run.smithi149.stdout:Suggested packages: 2023-01-24T22:01:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-01-24T22:01:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-01-24T22:01:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-01-24T22:01:23.507 INFO:teuthology.orchestra.run.smithi149.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-01-24T22:01:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-01-24T22:01:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-01-24T22:01:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-01-24T22:01:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-01-24T22:01:23.508 INFO:teuthology.orchestra.run.smithi149.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-01-24T22:01:23.509 INFO:teuthology.orchestra.run.smithi149.stdout:Recommended packages: 2023-01-24T22:01:23.509 INFO:teuthology.orchestra.run.smithi149.stdout: btrfs-tools 2023-01-24T22:01:23.577 INFO:teuthology.orchestra.run.smithi100.stdout:The following NEW packages will be installed: 2023-01-24T22:01:23.578 INFO:teuthology.orchestra.run.smithi100.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-01-24T22:01:23.578 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-01-24T22:01:23.579 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-01-24T22:01:23.579 INFO:teuthology.orchestra.run.smithi100.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-01-24T22:01:23.579 INFO:teuthology.orchestra.run.smithi100.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-01-24T22:01:23.580 INFO:teuthology.orchestra.run.smithi100.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-01-24T22:01:23.580 INFO:teuthology.orchestra.run.smithi100.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-01-24T22:01:23.581 INFO:teuthology.orchestra.run.smithi100.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-natsort-doc 2023-01-24T22:01:23.581 INFO:teuthology.orchestra.run.smithi100.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2023-01-24T22:01:23.581 INFO:teuthology.orchestra.run.smithi100.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-01-24T22:01:23.582 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2023-01-24T22:01:23.582 INFO:teuthology.orchestra.run.smithi100.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-01-24T22:01:23.582 INFO:teuthology.orchestra.run.smithi100.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-01-24T22:01:23.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-01-24T22:01:23.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2023-01-24T22:01:23.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2023-01-24T22:01:23.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-01-24T22:01:23.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2023-01-24T22:01:23.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2023-01-24T22:01:23.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-01-24T22:01:23.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-01-24T22:01:23.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-01-24T22:01:23.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-01-24T22:01:23.585 INFO:teuthology.orchestra.run.smithi100.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-01-24T22:01:23.585 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages will be upgraded: 2023-01-24T22:01:23.586 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 librbd1 2023-01-24T22:01:23.615 INFO:teuthology.orchestra.run.smithi149.stdout:The following NEW packages will be installed: 2023-01-24T22:01:23.616 INFO:teuthology.orchestra.run.smithi149.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-01-24T22:01:23.616 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-01-24T22:01:23.616 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-01-24T22:01:23.616 INFO:teuthology.orchestra.run.smithi149.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-01-24T22:01:23.617 INFO:teuthology.orchestra.run.smithi149.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-01-24T22:01:23.617 INFO:teuthology.orchestra.run.smithi149.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-01-24T22:01:23.617 INFO:teuthology.orchestra.run.smithi149.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-01-24T22:01:23.618 INFO:teuthology.orchestra.run.smithi149.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-natsort-doc 2023-01-24T22:01:23.618 INFO:teuthology.orchestra.run.smithi149.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2023-01-24T22:01:23.618 INFO:teuthology.orchestra.run.smithi149.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-01-24T22:01:23.619 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2023-01-24T22:01:23.619 INFO:teuthology.orchestra.run.smithi149.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-01-24T22:01:23.619 INFO:teuthology.orchestra.run.smithi149.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-01-24T22:01:23.619 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-01-24T22:01:23.619 INFO:teuthology.orchestra.run.smithi149.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2023-01-24T22:01:23.620 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2023-01-24T22:01:23.620 INFO:teuthology.orchestra.run.smithi149.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-01-24T22:01:23.620 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2023-01-24T22:01:23.620 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2023-01-24T22:01:23.620 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-01-24T22:01:23.622 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-01-24T22:01:23.622 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-01-24T22:01:23.623 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-01-24T22:01:23.623 INFO:teuthology.orchestra.run.smithi149.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-01-24T22:01:23.623 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages will be upgraded: 2023-01-24T22:01:23.623 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 librbd1 2023-01-24T22:01:23.647 INFO:teuthology.orchestra.run.smithi100.stdout:2 upgraded, 108 newly installed, 0 to remove and 120 not upgraded. 2023-01-24T22:01:23.647 INFO:teuthology.orchestra.run.smithi100.stdout:Need to get 209 MB of archives. 2023-01-24T22:01:23.647 INFO:teuthology.orchestra.run.smithi100.stdout:After this operation, 980 MB of additional disk space will be used. 2023-01-24T22:01:23.648 INFO:teuthology.orchestra.run.smithi100.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-01-24T22:01:23.729 INFO:teuthology.orchestra.run.smithi100.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-01-24T22:01:23.731 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-01-24T22:01:23.735 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.5-727-g49f8fb05-1focal [3,502 kB] 2023-01-24T22:01:23.740 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-01-24T22:01:23.746 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-01-24T22:01:23.773 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-01-24T22:01:23.774 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-01-24T22:01:23.774 INFO:teuthology.orchestra.run.smithi149.stdout:2 upgraded, 108 newly installed, 0 to remove and 120 not upgraded. 2023-01-24T22:01:23.774 INFO:teuthology.orchestra.run.smithi149.stdout:Need to get 209 MB of archives. 2023-01-24T22:01:23.775 INFO:teuthology.orchestra.run.smithi149.stdout:After this operation, 980 MB of additional disk space will be used. 2023-01-24T22:01:23.775 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.5-727-g49f8fb05-1focal [3,502 kB] 2023-01-24T22:01:23.781 INFO:teuthology.orchestra.run.smithi100.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-01-24T22:01:23.816 INFO:teuthology.orchestra.run.smithi100.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-01-24T22:01:23.818 INFO:teuthology.orchestra.run.smithi100.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-01-24T22:01:23.825 INFO:teuthology.orchestra.run.smithi100.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-01-24T22:01:23.826 INFO:teuthology.orchestra.run.smithi100.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-01-24T22:01:23.827 INFO:teuthology.orchestra.run.smithi100.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-01-24T22:01:23.829 INFO:teuthology.orchestra.run.smithi100.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-01-24T22:01:23.830 INFO:teuthology.orchestra.run.smithi100.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-01-24T22:01:23.830 INFO:teuthology.orchestra.run.smithi100.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-01-24T22:01:23.831 INFO:teuthology.orchestra.run.smithi100.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-01-24T22:01:23.833 INFO:teuthology.orchestra.run.smithi100.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-01-24T22:01:23.849 INFO:teuthology.orchestra.run.smithi100.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-01-24T22:01:23.850 INFO:teuthology.orchestra.run.smithi100.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-01-24T22:01:23.850 INFO:teuthology.orchestra.run.smithi100.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-01-24T22:01:23.851 INFO:teuthology.orchestra.run.smithi100.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-01-24T22:01:23.851 INFO:teuthology.orchestra.run.smithi100.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-01-24T22:01:23.852 INFO:teuthology.orchestra.run.smithi100.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-01-24T22:01:23.853 INFO:teuthology.orchestra.run.smithi100.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-01-24T22:01:23.853 INFO:teuthology.orchestra.run.smithi100.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-01-24T22:01:23.855 INFO:teuthology.orchestra.run.smithi100.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-01-24T22:01:23.867 INFO:teuthology.orchestra.run.smithi100.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-01-24T22:01:23.875 INFO:teuthology.orchestra.run.smithi100.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-01-24T22:01:23.880 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-01-24T22:01:23.881 INFO:teuthology.orchestra.run.smithi100.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-01-24T22:01:23.882 INFO:teuthology.orchestra.run.smithi100.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-01-24T22:01:23.883 INFO:teuthology.orchestra.run.smithi100.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-01-24T22:01:23.884 INFO:teuthology.orchestra.run.smithi100.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-01-24T22:01:23.886 INFO:teuthology.orchestra.run.smithi100.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2023-01-24T22:01:23.889 INFO:teuthology.orchestra.run.smithi100.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-01-24T22:01:23.890 INFO:teuthology.orchestra.run.smithi100.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-01-24T22:01:23.890 INFO:teuthology.orchestra.run.smithi100.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-01-24T22:01:23.901 INFO:teuthology.orchestra.run.smithi100.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-01-24T22:01:23.901 INFO:teuthology.orchestra.run.smithi100.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-01-24T22:01:23.903 INFO:teuthology.orchestra.run.smithi100.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-01-24T22:01:23.917 INFO:teuthology.orchestra.run.smithi100.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-01-24T22:01:23.918 INFO:teuthology.orchestra.run.smithi100.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-01-24T22:01:23.988 INFO:teuthology.orchestra.run.smithi100.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.5-727-g49f8fb05-1focal [3,550 kB] 2023-01-24T22:01:23.999 INFO:teuthology.orchestra.run.smithi100.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-01-24T22:01:24.015 INFO:teuthology.orchestra.run.smithi100.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-01-24T22:01:24.016 INFO:teuthology.orchestra.run.smithi100.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-01-24T22:01:24.028 INFO:teuthology.orchestra.run.smithi100.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-01-24T22:01:24.029 INFO:teuthology.orchestra.run.smithi100.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-01-24T22:01:24.029 INFO:teuthology.orchestra.run.smithi100.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-01-24T22:01:24.030 INFO:teuthology.orchestra.run.smithi100.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-01-24T22:01:24.030 INFO:teuthology.orchestra.run.smithi100.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-01-24T22:01:24.030 INFO:teuthology.orchestra.run.smithi100.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-01-24T22:01:24.031 INFO:teuthology.orchestra.run.smithi100.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-01-24T22:01:24.034 INFO:teuthology.orchestra.run.smithi100.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-01-24T22:01:24.049 INFO:teuthology.orchestra.run.smithi100.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-01-24T22:01:24.049 INFO:teuthology.orchestra.run.smithi100.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-01-24T22:01:24.052 INFO:teuthology.orchestra.run.smithi100.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-01-24T22:01:24.054 INFO:teuthology.orchestra.run.smithi100.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-01-24T22:01:24.056 INFO:teuthology.orchestra.run.smithi100.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-01-24T22:01:24.057 INFO:teuthology.orchestra.run.smithi100.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-01-24T22:01:24.059 INFO:teuthology.orchestra.run.smithi100.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-01-24T22:01:24.061 INFO:teuthology.orchestra.run.smithi100.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-01-24T22:01:24.076 INFO:teuthology.orchestra.run.smithi100.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-01-24T22:01:24.079 INFO:teuthology.orchestra.run.smithi100.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-01-24T22:01:24.115 INFO:teuthology.orchestra.run.smithi100.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-01-24T22:01:24.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-01-24T22:01:24.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-01-24T22:01:24.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-01-24T22:01:24.117 INFO:teuthology.orchestra.run.smithi100.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-01-24T22:01:24.118 INFO:teuthology.orchestra.run.smithi100.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-01-24T22:01:24.129 INFO:teuthology.orchestra.run.smithi100.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-01-24T22:01:24.130 INFO:teuthology.orchestra.run.smithi100.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-01-24T22:01:24.131 INFO:teuthology.orchestra.run.smithi100.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-01-24T22:01:24.132 INFO:teuthology.orchestra.run.smithi100.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-01-24T22:01:24.144 INFO:teuthology.orchestra.run.smithi100.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.5-727-g49f8fb05-1focal [755 kB] 2023-01-24T22:01:24.149 INFO:teuthology.orchestra.run.smithi100.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-01-24T22:01:24.150 INFO:teuthology.orchestra.run.smithi100.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-01-24T22:01:24.151 INFO:teuthology.orchestra.run.smithi100.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-01-24T22:01:24.151 INFO:teuthology.orchestra.run.smithi100.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-01-24T22:01:24.153 INFO:teuthology.orchestra.run.smithi100.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-01-24T22:01:24.153 INFO:teuthology.orchestra.run.smithi100.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-01-24T22:01:24.168 INFO:teuthology.orchestra.run.smithi100.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.5-727-g49f8fb05-1focal [412 kB] 2023-01-24T22:01:24.181 INFO:teuthology.orchestra.run.smithi100.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.5-727-g49f8fb05-1focal [22.5 kB] 2023-01-24T22:01:24.182 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.5-727-g49f8fb05-1focal [3,550 kB] 2023-01-24T22:01:24.184 INFO:teuthology.orchestra.run.smithi100.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.5-727-g49f8fb05-1focal [200 kB] 2023-01-24T22:01:24.305 INFO:teuthology.orchestra.run.smithi100.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.5-727-g49f8fb05-1focal [43.4 kB] 2023-01-24T22:01:24.306 INFO:teuthology.orchestra.run.smithi100.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.5-727-g49f8fb05-1focal [384 kB] 2023-01-24T22:01:24.313 INFO:teuthology.orchestra.run.smithi100.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.5-727-g49f8fb05-1focal [5,528 kB] 2023-01-24T22:01:24.321 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-01-24T22:01:24.330 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-01-24T22:01:24.380 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-01-24T22:01:24.395 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-01-24T22:01:24.465 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.5-727-g49f8fb05-1focal [755 kB] 2023-01-24T22:01:24.526 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.5-727-g49f8fb05-1focal [412 kB] 2023-01-24T22:01:24.534 INFO:teuthology.orchestra.run.smithi100.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.5-727-g49f8fb05-1focal [116 kB] 2023-01-24T22:01:24.534 INFO:teuthology.orchestra.run.smithi149.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-01-24T22:01:24.536 INFO:teuthology.orchestra.run.smithi100.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.5-727-g49f8fb05-1focal [479 kB] 2023-01-24T22:01:24.541 INFO:teuthology.orchestra.run.smithi149.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-01-24T22:01:24.549 INFO:teuthology.orchestra.run.smithi100.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.5-727-g49f8fb05-1focal [27.1 MB] 2023-01-24T22:01:24.568 INFO:teuthology.orchestra.run.smithi149.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.5-727-g49f8fb05-1focal [22.5 kB] 2023-01-24T22:01:24.569 INFO:teuthology.orchestra.run.smithi149.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.5-727-g49f8fb05-1focal [200 kB] 2023-01-24T22:01:24.574 INFO:teuthology.orchestra.run.smithi149.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-01-24T22:01:24.575 INFO:teuthology.orchestra.run.smithi149.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.5-727-g49f8fb05-1focal [43.4 kB] 2023-01-24T22:01:24.578 INFO:teuthology.orchestra.run.smithi149.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.5-727-g49f8fb05-1focal [384 kB] 2023-01-24T22:01:24.624 INFO:teuthology.orchestra.run.smithi149.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.5-727-g49f8fb05-1focal [5,528 kB] 2023-01-24T22:01:24.733 INFO:teuthology.orchestra.run.smithi149.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-01-24T22:01:24.741 INFO:teuthology.orchestra.run.smithi149.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-01-24T22:01:24.767 INFO:teuthology.orchestra.run.smithi149.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-01-24T22:01:24.777 INFO:teuthology.orchestra.run.smithi149.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-01-24T22:01:24.778 INFO:teuthology.orchestra.run.smithi149.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-01-24T22:01:24.783 INFO:teuthology.orchestra.run.smithi149.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-01-24T22:01:24.784 INFO:teuthology.orchestra.run.smithi149.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-01-24T22:01:24.785 INFO:teuthology.orchestra.run.smithi149.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-01-24T22:01:24.789 INFO:teuthology.orchestra.run.smithi149.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-01-24T22:01:24.825 INFO:teuthology.orchestra.run.smithi149.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-01-24T22:01:24.883 INFO:teuthology.orchestra.run.smithi149.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-01-24T22:01:24.883 INFO:teuthology.orchestra.run.smithi149.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-01-24T22:01:24.884 INFO:teuthology.orchestra.run.smithi149.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-01-24T22:01:24.885 INFO:teuthology.orchestra.run.smithi149.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-01-24T22:01:24.885 INFO:teuthology.orchestra.run.smithi149.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-01-24T22:01:24.886 INFO:teuthology.orchestra.run.smithi149.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-01-24T22:01:24.887 INFO:teuthology.orchestra.run.smithi149.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-01-24T22:01:24.888 INFO:teuthology.orchestra.run.smithi149.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-01-24T22:01:24.915 INFO:teuthology.orchestra.run.smithi149.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-01-24T22:01:24.985 INFO:teuthology.orchestra.run.smithi149.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-01-24T22:01:24.985 INFO:teuthology.orchestra.run.smithi149.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-01-24T22:01:24.992 INFO:teuthology.orchestra.run.smithi149.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-01-24T22:01:24.993 INFO:teuthology.orchestra.run.smithi149.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-01-24T22:01:24.994 INFO:teuthology.orchestra.run.smithi149.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-01-24T22:01:24.994 INFO:teuthology.orchestra.run.smithi149.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-01-24T22:01:24.994 INFO:teuthology.orchestra.run.smithi149.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2023-01-24T22:01:24.997 INFO:teuthology.orchestra.run.smithi149.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-01-24T22:01:25.007 INFO:teuthology.orchestra.run.smithi149.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-01-24T22:01:25.089 INFO:teuthology.orchestra.run.smithi149.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-01-24T22:01:25.092 INFO:teuthology.orchestra.run.smithi149.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-01-24T22:01:25.094 INFO:teuthology.orchestra.run.smithi149.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-01-24T22:01:25.095 INFO:teuthology.orchestra.run.smithi149.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.5-727-g49f8fb05-1focal [116 kB] 2023-01-24T22:01:25.096 INFO:teuthology.orchestra.run.smithi149.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-01-24T22:01:25.097 INFO:teuthology.orchestra.run.smithi149.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-01-24T22:01:25.098 INFO:teuthology.orchestra.run.smithi149.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-01-24T22:01:25.100 INFO:teuthology.orchestra.run.smithi149.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.5-727-g49f8fb05-1focal [479 kB] 2023-01-24T22:01:25.152 INFO:teuthology.orchestra.run.smithi149.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.5-727-g49f8fb05-1focal [27.1 MB] 2023-01-24T22:01:25.401 INFO:teuthology.orchestra.run.smithi149.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-01-24T22:01:25.486 INFO:teuthology.orchestra.run.smithi149.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-01-24T22:01:25.488 INFO:teuthology.orchestra.run.smithi149.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-01-24T22:01:25.549 INFO:teuthology.orchestra.run.smithi149.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-01-24T22:01:25.551 INFO:teuthology.orchestra.run.smithi149.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-01-24T22:01:25.552 INFO:teuthology.orchestra.run.smithi149.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-01-24T22:01:25.552 INFO:teuthology.orchestra.run.smithi149.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-01-24T22:01:25.553 INFO:teuthology.orchestra.run.smithi149.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-01-24T22:01:25.553 INFO:teuthology.orchestra.run.smithi149.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-01-24T22:01:25.554 INFO:teuthology.orchestra.run.smithi149.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-01-24T22:01:25.585 INFO:teuthology.orchestra.run.smithi149.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-01-24T22:01:25.585 INFO:teuthology.orchestra.run.smithi149.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-01-24T22:01:25.676 INFO:teuthology.orchestra.run.smithi149.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-01-24T22:01:25.681 INFO:teuthology.orchestra.run.smithi149.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-01-24T22:01:25.684 INFO:teuthology.orchestra.run.smithi149.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-01-24T22:01:25.687 INFO:teuthology.orchestra.run.smithi149.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-01-24T22:01:25.689 INFO:teuthology.orchestra.run.smithi149.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-01-24T22:01:25.691 INFO:teuthology.orchestra.run.smithi149.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-01-24T22:01:25.694 INFO:teuthology.orchestra.run.smithi149.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-01-24T22:01:25.771 INFO:teuthology.orchestra.run.smithi149.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-01-24T22:01:25.775 INFO:teuthology.orchestra.run.smithi149.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-01-24T22:01:25.897 INFO:teuthology.orchestra.run.smithi149.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-01-24T22:01:25.948 INFO:teuthology.orchestra.run.smithi149.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-01-24T22:01:25.948 INFO:teuthology.orchestra.run.smithi149.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-01-24T22:01:25.948 INFO:teuthology.orchestra.run.smithi149.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-01-24T22:01:25.949 INFO:teuthology.orchestra.run.smithi149.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-01-24T22:01:25.950 INFO:teuthology.orchestra.run.smithi149.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-01-24T22:01:25.976 INFO:teuthology.orchestra.run.smithi149.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-01-24T22:01:25.976 INFO:teuthology.orchestra.run.smithi149.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-01-24T22:01:25.976 INFO:teuthology.orchestra.run.smithi149.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-01-24T22:01:26.037 INFO:teuthology.orchestra.run.smithi149.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-01-24T22:01:26.082 INFO:teuthology.orchestra.run.smithi100.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.5-727-g49f8fb05-1focal [6,439 kB] 2023-01-24T22:01:26.128 INFO:teuthology.orchestra.run.smithi149.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-01-24T22:01:26.130 INFO:teuthology.orchestra.run.smithi149.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-01-24T22:01:26.131 INFO:teuthology.orchestra.run.smithi149.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-01-24T22:01:26.131 INFO:teuthology.orchestra.run.smithi149.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-01-24T22:01:26.135 INFO:teuthology.orchestra.run.smithi149.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-01-24T22:01:26.136 INFO:teuthology.orchestra.run.smithi149.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-01-24T22:01:26.346 INFO:teuthology.orchestra.run.smithi100.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.5-727-g49f8fb05-1focal [218 kB] 2023-01-24T22:01:26.352 INFO:teuthology.orchestra.run.smithi100.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.5-727-g49f8fb05-1focal [152 kB] 2023-01-24T22:01:26.359 INFO:teuthology.orchestra.run.smithi100.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.5-727-g49f8fb05-1focal [1,583 kB] 2023-01-24T22:01:26.437 INFO:teuthology.orchestra.run.smithi100.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.5-727-g49f8fb05-1focal [7,828 kB] 2023-01-24T22:01:26.855 INFO:teuthology.orchestra.run.smithi100.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.5-727-g49f8fb05-1focal [28.6 MB] 2023-01-24T22:01:27.672 INFO:teuthology.orchestra.run.smithi149.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.5-727-g49f8fb05-1focal [6,439 kB] 2023-01-24T22:01:28.139 INFO:teuthology.orchestra.run.smithi149.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.5-727-g49f8fb05-1focal [218 kB] 2023-01-24T22:01:28.154 INFO:teuthology.orchestra.run.smithi149.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.5-727-g49f8fb05-1focal [152 kB] 2023-01-24T22:01:28.159 INFO:teuthology.orchestra.run.smithi149.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.5-727-g49f8fb05-1focal [1,583 kB] 2023-01-24T22:01:28.313 INFO:teuthology.orchestra.run.smithi149.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.5-727-g49f8fb05-1focal [7,828 kB] 2023-01-24T22:01:28.384 INFO:teuthology.orchestra.run.smithi100.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.5-727-g49f8fb05-1focal [3,904 B] 2023-01-24T22:01:28.454 INFO:teuthology.orchestra.run.smithi100.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.5-727-g49f8fb05-1focal [865 kB] 2023-01-24T22:01:28.468 INFO:teuthology.orchestra.run.smithi100.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.5-727-g49f8fb05-1focal [2,387 kB] 2023-01-24T22:01:28.486 INFO:teuthology.orchestra.run.smithi100.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.5-727-g49f8fb05-1focal [77.0 kB] 2023-01-24T22:01:28.488 INFO:teuthology.orchestra.run.smithi100.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.5-727-g49f8fb05-1focal [111 kB] 2023-01-24T22:01:28.490 INFO:teuthology.orchestra.run.smithi100.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.5-727-g49f8fb05-1focal [1,713 kB] 2023-01-24T22:01:28.578 INFO:teuthology.orchestra.run.smithi100.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.5-727-g49f8fb05-1focal [7,878 kB] 2023-01-24T22:01:29.041 INFO:teuthology.orchestra.run.smithi149.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.5-727-g49f8fb05-1focal [28.6 MB] 2023-01-24T22:01:29.068 INFO:teuthology.orchestra.run.smithi100.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.5-727-g49f8fb05-1focal [4,020 B] 2023-01-24T22:01:29.068 INFO:teuthology.orchestra.run.smithi100.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.5-727-g49f8fb05-1focal [56.6 MB] 2023-01-24T22:01:31.194 INFO:teuthology.orchestra.run.smithi149.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.5-727-g49f8fb05-1focal [3,904 B] 2023-01-24T22:01:31.195 INFO:teuthology.orchestra.run.smithi149.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.5-727-g49f8fb05-1focal [865 kB] 2023-01-24T22:01:31.210 INFO:teuthology.orchestra.run.smithi149.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.5-727-g49f8fb05-1focal [2,387 kB] 2023-01-24T22:01:31.334 INFO:teuthology.orchestra.run.smithi149.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.5-727-g49f8fb05-1focal [77.0 kB] 2023-01-24T22:01:31.336 INFO:teuthology.orchestra.run.smithi149.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.5-727-g49f8fb05-1focal [111 kB] 2023-01-24T22:01:31.347 INFO:teuthology.orchestra.run.smithi149.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.5-727-g49f8fb05-1focal [1,713 kB] 2023-01-24T22:01:31.485 INFO:teuthology.orchestra.run.smithi149.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.5-727-g49f8fb05-1focal [7,878 kB] 2023-01-24T22:01:32.051 INFO:teuthology.orchestra.run.smithi149.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.5-727-g49f8fb05-1focal [4,020 B] 2023-01-24T22:01:32.051 INFO:teuthology.orchestra.run.smithi149.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.5-727-g49f8fb05-1focal [56.6 MB] 2023-01-24T22:01:32.663 INFO:teuthology.orchestra.run.smithi100.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.5-727-g49f8fb05-1focal [225 kB] 2023-01-24T22:01:32.668 INFO:teuthology.orchestra.run.smithi100.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.5-727-g49f8fb05-1focal [21.8 kB] 2023-01-24T22:01:32.668 INFO:teuthology.orchestra.run.smithi100.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.5-727-g49f8fb05-1focal [16.9 MB] 2023-01-24T22:01:33.517 INFO:teuthology.orchestra.run.smithi100.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.5-727-g49f8fb05-1focal [80.1 kB] 2023-01-24T22:01:34.137 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 209 MB in 10s (21.0 MB/s) 2023-01-24T22:01:34.306 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-01-24T22:01:34.363 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141754 files and directories currently installed.) 2023-01-24T22:01:34.367 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-01-24T22:01:34.455 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-24T22:01:34.811 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../001-librbd1_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:34.942 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librbd1 (17.2.5-727-g49f8fb05-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-24T22:01:34.949 INFO:teuthology.orchestra.run.smithi149.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.5-727-g49f8fb05-1focal [225 kB] 2023-01-24T22:01:34.954 INFO:teuthology.orchestra.run.smithi149.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.5-727-g49f8fb05-1focal [21.8 kB] 2023-01-24T22:01:34.954 INFO:teuthology.orchestra.run.smithi149.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.5-727-g49f8fb05-1focal [16.9 MB] 2023-01-24T22:01:35.503 INFO:teuthology.orchestra.run.smithi149.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri7-testing-2023-01-23-1532-quincy/49f8fb05584886826e8eade75f7105fba754560c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.5-727-g49f8fb05-1focal [80.1 kB] 2023-01-24T22:01:35.662 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../002-librados2_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:35.788 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librados2 (17.2.5-727-g49f8fb05-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-24T22:01:36.108 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 209 MB in 12s (17.6 MB/s) 2023-01-24T22:01:36.231 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-01-24T22:01:36.286 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141754 files and directories currently installed.) 2023-01-24T22:01:36.290 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-01-24T22:01:36.354 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-24T22:01:36.450 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libcephfs2. 2023-01-24T22:01:36.470 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../003-libcephfs2_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:36.509 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libcephfs2 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:36.691 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../001-librbd1_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:36.816 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librbd1 (17.2.5-727-g49f8fb05-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-24T22:01:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rados. 2023-01-24T22:01:36.850 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../004-python3-rados_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:36.886 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rados (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:37.247 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-01-24T22:01:37.264 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../005-python3-ceph-argparse_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:01:37.305 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-ceph-argparse (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:37.536 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../002-librados2_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:37.541 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cephfs. 2023-01-24T22:01:37.558 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../006-python3-cephfs_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:37.599 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cephfs (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:37.679 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librados2 (17.2.5-727-g49f8fb05-1focal) over (15.2.17-0ubuntu0.20.04.1) ... 2023-01-24T22:01:37.919 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-ceph-common. 2023-01-24T22:01:37.939 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../007-python3-ceph-common_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:01:37.977 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-ceph-common (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:38.238 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-prettytable. 2023-01-24T22:01:38.256 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../008-python3-prettytable_0.7.2-5_all.deb ... 2023-01-24T22:01:38.288 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-01-24T22:01:38.366 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libcephfs2. 2023-01-24T22:01:38.384 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../003-libcephfs2_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:38.424 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libcephfs2 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:38.508 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rbd. 2023-01-24T22:01:38.527 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../009-python3-rbd_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:38.565 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rbd (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:38.768 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rados. 2023-01-24T22:01:38.787 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../004-python3-rados_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:38.826 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rados (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:38.919 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-01-24T22:01:38.939 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../010-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-01-24T22:01:38.977 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-24T22:01:39.188 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-01-24T22:01:39.207 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../005-python3-ceph-argparse_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:01:39.246 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-ceph-argparse (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:39.322 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-01-24T22:01:39.339 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../011-librabbitmq4_0.10.0-1_amd64.deb ... 2023-01-24T22:01:39.380 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-01-24T22:01:39.457 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cephfs. 2023-01-24T22:01:39.474 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../006-python3-cephfs_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:39.506 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cephfs (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:39.658 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-01-24T22:01:39.676 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../012-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-01-24T22:01:39.716 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-24T22:01:39.868 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-ceph-common. 2023-01-24T22:01:39.884 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../007-python3-ceph-common_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:01:39.926 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-ceph-common (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:40.094 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-01-24T22:01:40.113 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../013-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-01-24T22:01:40.177 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-24T22:01:40.254 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-prettytable. 2023-01-24T22:01:40.275 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../008-python3-prettytable_0.7.2-5_all.deb ... 2023-01-24T22:01:40.312 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-01-24T22:01:40.464 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-01-24T22:01:40.479 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../014-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-01-24T22:01:40.514 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-24T22:01:40.589 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rbd. 2023-01-24T22:01:40.607 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../009-python3-rbd_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:40.648 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rbd (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:40.909 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-01-24T22:01:40.925 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../015-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-24T22:01:40.977 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-24T22:01:41.000 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-01-24T22:01:41.016 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../010-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-01-24T22:01:41.050 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-24T22:01:41.453 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-01-24T22:01:41.469 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../011-librabbitmq4_0.10.0-1_amd64.deb ... 2023-01-24T22:01:41.481 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-01-24T22:01:41.499 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../016-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-24T22:01:41.512 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-01-24T22:01:41.532 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-24T22:01:42.090 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-01-24T22:01:42.107 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../012-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-01-24T22:01:42.121 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-01-24T22:01:42.137 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../017-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-24T22:01:42.148 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-24T22:01:42.179 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-24T22:01:42.492 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-01-24T22:01:42.511 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../013-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-01-24T22:01:42.542 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-24T22:01:42.574 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-01-24T22:01:42.589 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../018-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-01-24T22:01:42.632 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-24T22:01:42.871 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-01-24T22:01:42.888 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../014-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-01-24T22:01:42.930 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-24T22:01:42.994 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librgw2. 2023-01-24T22:01:43.010 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../019-librgw2_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:43.052 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librgw2 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:43.393 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-01-24T22:01:43.412 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../015-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-24T22:01:43.462 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-24T22:01:43.804 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rgw. 2023-01-24T22:01:43.823 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../020-python3-rgw_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:43.862 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rgw (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:43.999 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-01-24T22:01:44.016 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../016-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-24T22:01:44.057 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-24T22:01:44.157 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liboath0. 2023-01-24T22:01:44.173 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-01-24T22:01:44.207 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-01-24T22:01:44.469 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-01-24T22:01:44.487 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../017-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-01-24T22:01:44.511 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libradosstriper1. 2023-01-24T22:01:44.526 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../022-libradosstriper1_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:44.527 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-24T22:01:44.569 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libradosstriper1 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:44.913 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-01-24T22:01:44.931 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../018-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-01-24T22:01:44.963 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-24T22:01:45.047 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-common. 2023-01-24T22:01:45.066 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../023-ceph-common_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:45.105 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-common (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:45.317 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librgw2. 2023-01-24T22:01:45.332 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../019-librgw2_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:45.374 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librgw2 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:46.144 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rgw. 2023-01-24T22:01:46.161 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../020-python3-rgw_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:46.194 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rgw (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:46.597 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liboath0. 2023-01-24T22:01:46.613 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-01-24T22:01:46.655 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-01-24T22:01:46.999 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libradosstriper1. 2023-01-24T22:01:47.016 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../022-libradosstriper1_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:47.058 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libradosstriper1 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:47.478 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-common. 2023-01-24T22:01:47.496 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../023-ceph-common_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:47.527 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-common (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:47.669 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-base. 2023-01-24T22:01:47.686 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../024-ceph-base_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:47.728 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-base (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:48.732 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cryptography. 2023-01-24T22:01:48.751 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../025-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-01-24T22:01:48.790 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-24T22:01:49.160 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-openssl. 2023-01-24T22:01:49.176 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../026-python3-openssl_19.0.0-1build1_all.deb ... 2023-01-24T22:01:49.219 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-01-24T22:01:49.513 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-01-24T22:01:49.529 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../027-ceph-mgr-modules-core_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:01:49.571 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-modules-core (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:49.951 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-bcrypt. 2023-01-24T22:01:49.968 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../028-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-01-24T22:01:50.009 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-24T22:01:50.274 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-base. 2023-01-24T22:01:50.291 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../024-ceph-base_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:50.303 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cherrypy3. 2023-01-24T22:01:50.320 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../029-python3-cherrypy3_8.9.1-6_all.deb ... 2023-01-24T22:01:50.343 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-base (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:50.361 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-01-24T22:01:50.648 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-natsort. 2023-01-24T22:01:50.666 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../030-python3-natsort_7.0.1-1_all.deb ... 2023-01-24T22:01:50.706 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-01-24T22:01:51.060 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-jwt. 2023-01-24T22:01:51.077 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../031-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-01-24T22:01:51.118 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-24T22:01:51.370 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cryptography. 2023-01-24T22:01:51.387 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../025-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-01-24T22:01:51.429 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-logutils. 2023-01-24T22:01:51.445 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../032-python3-logutils_0.3.3-7_all.deb ... 2023-01-24T22:01:51.453 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-24T22:01:51.488 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-01-24T22:01:51.766 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-markupsafe. 2023-01-24T22:01:51.784 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../033-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-01-24T22:01:51.824 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-01-24T22:01:51.840 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-openssl. 2023-01-24T22:01:51.856 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../026-python3-openssl_19.0.0-1build1_all.deb ... 2023-01-24T22:01:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-01-24T22:01:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-mako. 2023-01-24T22:01:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../034-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-01-24T22:01:52.233 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-24T22:01:52.484 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-01-24T22:01:52.503 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../027-ceph-mgr-modules-core_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:01:52.542 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-modules-core (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:52.791 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-simplegeneric. 2023-01-24T22:01:52.811 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../035-python3-simplegeneric_0.8.1-3_all.deb ... 2023-01-24T22:01:52.849 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-01-24T22:01:52.948 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-bcrypt. 2023-01-24T22:01:52.964 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../028-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-01-24T22:01:53.006 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-24T22:01:53.094 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-singledispatch. 2023-01-24T22:01:53.112 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../036-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-01-24T22:01:53.144 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-01-24T22:01:53.333 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cherrypy3. 2023-01-24T22:01:53.349 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../029-python3-cherrypy3_8.9.1-6_all.deb ... 2023-01-24T22:01:53.392 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-01-24T22:01:53.430 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-webob. 2023-01-24T22:01:53.448 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../037-python3-webob_1%3a1.8.5-2_all.deb ... 2023-01-24T22:01:53.488 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-01-24T22:01:53.755 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-natsort. 2023-01-24T22:01:53.772 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../030-python3-natsort_7.0.1-1_all.deb ... 2023-01-24T22:01:53.791 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-soupsieve. 2023-01-24T22:01:53.811 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../038-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-01-24T22:01:53.813 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-01-24T22:01:53.849 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-24T22:01:54.125 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jwt. 2023-01-24T22:01:54.141 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../031-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-01-24T22:01:54.177 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-bs4. 2023-01-24T22:01:54.191 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-24T22:01:54.196 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../039-python3-bs4_4.8.2-1_all.deb ... 2023-01-24T22:01:54.236 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-01-24T22:01:54.486 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-logutils. 2023-01-24T22:01:54.506 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../032-python3-logutils_0.3.3-7_all.deb ... 2023-01-24T22:01:54.544 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-01-24T22:01:54.555 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-waitress. 2023-01-24T22:01:54.575 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../040-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-01-24T22:01:54.608 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-24T22:01:54.875 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-markupsafe. 2023-01-24T22:01:54.894 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../033-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-01-24T22:01:54.934 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-tempita. 2023-01-24T22:01:54.935 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-01-24T22:01:54.950 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-6_all.deb ... 2023-01-24T22:01:54.991 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-01-24T22:01:55.269 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-mako. 2023-01-24T22:01:55.285 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../034-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-01-24T22:01:55.295 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-paste. 2023-01-24T22:01:55.311 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../042-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-01-24T22:01:55.327 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-24T22:01:55.353 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-01-24T22:01:55.690 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-01-24T22:01:55.698 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-simplegeneric. 2023-01-24T22:01:55.707 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-01-24T22:01:55.713 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../035-python3-simplegeneric_0.8.1-3_all.deb ... 2023-01-24T22:01:55.747 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-01-24T22:01:55.756 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-01-24T22:01:56.025 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pastedeploy. 2023-01-24T22:01:56.043 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../044-python3-pastedeploy_2.1.0-1_all.deb ... 2023-01-24T22:01:56.084 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-01-24T22:01:56.092 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-singledispatch. 2023-01-24T22:01:56.108 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../036-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-01-24T22:01:56.150 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-01-24T22:01:56.387 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-webtest. 2023-01-24T22:01:56.404 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../045-python3-webtest_2.0.32-2_all.deb ... 2023-01-24T22:01:56.445 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-01-24T22:01:56.478 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webob. 2023-01-24T22:01:56.495 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../037-python3-webob_1%3a1.8.5-2_all.deb ... 2023-01-24T22:01:56.536 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-01-24T22:01:56.740 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pecan. 2023-01-24T22:01:56.759 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../046-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-01-24T22:01:56.798 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-01-24T22:01:56.898 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-soupsieve. 2023-01-24T22:01:56.914 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../038-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-01-24T22:01:56.956 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-24T22:01:57.203 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-werkzeug. 2023-01-24T22:01:57.218 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../047-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2023-01-24T22:01:57.259 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-bs4. 2023-01-24T22:01:57.261 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-24T22:01:57.276 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../039-python3-bs4_4.8.2-1_all.deb ... 2023-01-24T22:01:57.342 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-01-24T22:01:58.207 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-01-24T22:01:58.224 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../048-libsqlite3-mod-ceph_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:58.264 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libsqlite3-mod-ceph (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:58.387 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-waitress. 2023-01-24T22:01:58.404 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../040-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-01-24T22:01:58.448 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-24T22:01:58.600 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr. 2023-01-24T22:01:58.619 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../049-ceph-mgr_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:58.683 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:58.807 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-tempita. 2023-01-24T22:01:58.824 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-6_all.deb ... 2023-01-24T22:01:58.865 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-01-24T22:01:59.179 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mon. 2023-01-24T22:01:59.193 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-paste. 2023-01-24T22:01:59.194 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../050-ceph-mon_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:01:59.209 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../042-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-01-24T22:01:59.237 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mon (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:01:59.251 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-01-24T22:01:59.612 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-01-24T22:01:59.631 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-01-24T22:01:59.670 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-01-24T22:01:59.982 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pastedeploy. 2023-01-24T22:01:59.999 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../044-python3-pastedeploy_2.1.0-1_all.deb ... 2023-01-24T22:02:00.065 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-01-24T22:02:00.318 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webtest. 2023-01-24T22:02:00.337 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../045-python3-webtest_2.0.32-2_all.deb ... 2023-01-24T22:02:00.376 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-01-24T22:02:00.382 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-osd. 2023-01-24T22:02:00.400 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../051-ceph-osd_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:00.440 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-osd (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:00.629 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pecan. 2023-01-24T22:02:00.647 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../046-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-01-24T22:02:00.678 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-01-24T22:02:01.058 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-werkzeug. 2023-01-24T22:02:01.078 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../047-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2023-01-24T22:02:01.116 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-24T22:02:01.495 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-01-24T22:02:01.512 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../048-libsqlite3-mod-ceph_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:01.552 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libsqlite3-mod-ceph (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:01.931 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr. 2023-01-24T22:02:01.948 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../049-ceph-mgr_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:01.997 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:02.509 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mon. 2023-01-24T22:02:02.525 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../050-ceph-mon_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:02.567 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mon (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:03.145 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph. 2023-01-24T22:02:03.161 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../052-ceph_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:03.203 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:03.531 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-fuse. 2023-01-24T22:02:03.548 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../053-ceph-fuse_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:03.581 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-fuse (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:03.746 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-osd. 2023-01-24T22:02:03.766 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../051-ceph-osd_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:03.803 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-osd (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:03.992 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mds. 2023-01-24T22:02:04.008 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../054-ceph-mds_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:04.050 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mds (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:04.578 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package cephadm. 2023-01-24T22:02:04.599 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../055-cephadm_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:04.636 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking cephadm (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:04.981 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-jinja2. 2023-01-24T22:02:04.997 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2_all.deb ... 2023-01-24T22:02:05.039 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-01-24T22:02:05.358 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-01-24T22:02:05.378 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:02:05.416 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-cephadm (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:05.761 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-repoze.lru. 2023-01-24T22:02:05.778 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../058-python3-repoze.lru_0.7-2_all.deb ... 2023-01-24T22:02:05.828 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-01-24T22:02:06.055 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjs-underscore. 2023-01-24T22:02:06.072 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../059-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-01-24T22:02:06.113 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-24T22:02:06.408 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-01-24T22:02:06.424 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../060-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-01-24T22:02:06.466 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-24T22:02:06.657 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph. 2023-01-24T22:02:06.673 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../052-ceph_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:06.706 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:06.802 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-routes. 2023-01-24T22:02:06.818 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../061-python3-routes_2.4.1-2_all.deb ... 2023-01-24T22:02:06.860 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-01-24T22:02:07.034 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-fuse. 2023-01-24T22:02:07.052 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../053-ceph-fuse_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:07.092 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-fuse (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:07.180 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-01-24T22:02:07.199 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../062-ceph-mgr-dashboard_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:02:07.238 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-dashboard (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:07.496 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mds. 2023-01-24T22:02:07.512 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../054-ceph-mds_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:07.554 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mds (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:07.691 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-decorator. 2023-01-24T22:02:07.711 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../063-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-01-24T22:02:07.749 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-01-24T22:02:08.052 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-01-24T22:02:08.069 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../064-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-01-24T22:02:08.098 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephadm. 2023-01-24T22:02:08.102 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-24T22:02:08.118 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../055-cephadm_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:08.157 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephadm (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:08.472 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-scipy. 2023-01-24T22:02:08.488 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../065-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-01-24T22:02:08.530 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-01-24T22:02:08.551 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jinja2. 2023-01-24T22:02:08.568 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2_all.deb ... 2023-01-24T22:02:08.609 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-01-24T22:02:08.971 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-01-24T22:02:08.988 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:02:09.028 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-cephadm (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:09.357 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-repoze.lru. 2023-01-24T22:02:09.375 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../058-python3-repoze.lru_0.7-2_all.deb ... 2023-01-24T22:02:09.407 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-01-24T22:02:09.684 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjs-underscore. 2023-01-24T22:02:09.701 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../059-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-01-24T22:02:09.742 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-24T22:02:09.788 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-01-24T22:02:09.805 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../066-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-01-24T22:02:09.846 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-24T22:02:10.011 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-01-24T22:02:10.024 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../060-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-01-24T22:02:10.094 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-24T22:02:10.391 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-joblib. 2023-01-24T22:02:10.405 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-routes. 2023-01-24T22:02:10.408 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../067-python3-joblib_0.14.0-3_all.deb ... 2023-01-24T22:02:10.424 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../061-python3-routes_2.4.1-2_all.deb ... 2023-01-24T22:02:10.449 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-01-24T22:02:10.472 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-01-24T22:02:10.811 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-sklearn. 2023-01-24T22:02:10.831 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../068-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-01-24T22:02:10.842 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-01-24T22:02:10.860 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../062-ceph-mgr-dashboard_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:02:10.869 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-24T22:02:10.900 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-dashboard (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:11.362 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-decorator. 2023-01-24T22:02:11.382 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../063-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-01-24T22:02:11.445 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-01-24T22:02:11.573 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-01-24T22:02:11.590 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../069-ceph-mgr-diskprediction-local_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:02:11.633 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:11.748 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-01-24T22:02:11.764 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../064-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-01-24T22:02:11.806 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-24T22:02:12.142 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-scipy. 2023-01-24T22:02:12.160 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../065-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-01-24T22:02:12.200 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-01-24T22:02:12.770 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cachetools. 2023-01-24T22:02:12.786 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../070-python3-cachetools_4.0.0-1_all.deb ... 2023-01-24T22:02:12.828 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-01-24T22:02:13.131 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyasn1. 2023-01-24T22:02:13.147 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-01-24T22:02:13.189 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-01-24T22:02:13.509 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-01-24T22:02:13.527 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-01-24T22:02:13.567 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-24T22:02:13.652 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-01-24T22:02:13.671 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../066-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-01-24T22:02:13.701 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-24T22:02:13.863 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rsa. 2023-01-24T22:02:13.880 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../073-python3-rsa_4.0-3_all.deb ... 2023-01-24T22:02:13.913 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rsa (4.0-3) ... 2023-01-24T22:02:14.233 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-google-auth. 2023-01-24T22:02:14.251 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../074-python3-google-auth_1.5.1-2_all.deb ... 2023-01-24T22:02:14.288 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-joblib. 2023-01-24T22:02:14.290 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-01-24T22:02:14.305 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../067-python3-joblib_0.14.0-3_all.deb ... 2023-01-24T22:02:14.346 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-01-24T22:02:14.595 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-blinker. 2023-01-24T22:02:14.614 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../075-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-01-24T22:02:14.653 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-24T22:02:14.725 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-sklearn. 2023-01-24T22:02:14.741 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../068-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-01-24T22:02:14.783 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-24T22:02:14.916 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-oauthlib. 2023-01-24T22:02:14.931 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../076-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-01-24T22:02:14.965 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-24T22:02:15.302 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-01-24T22:02:15.322 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../077-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-01-24T22:02:15.360 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-24T22:02:15.538 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-01-24T22:02:15.556 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../069-ceph-mgr-diskprediction-local_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:02:15.596 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:15.713 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-websocket. 2023-01-24T22:02:15.730 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../078-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-01-24T22:02:15.771 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-01-24T22:02:16.108 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-kubernetes. 2023-01-24T22:02:16.125 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../079-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-01-24T22:02:16.166 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-01-24T22:02:16.712 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-01-24T22:02:16.729 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../080-ceph-mgr-k8sevents_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:02:16.733 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cachetools. 2023-01-24T22:02:16.751 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../070-python3-cachetools_4.0.0-1_all.deb ... 2023-01-24T22:02:16.779 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-k8sevents (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:16.791 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-01-24T22:02:17.119 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyasn1. 2023-01-24T22:02:17.135 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-01-24T22:02:17.178 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-01-24T22:02:17.201 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libonig5:amd64. 2023-01-24T22:02:17.217 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../081-libonig5_6.9.4-1_amd64.deb ... 2023-01-24T22:02:17.258 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-01-24T22:02:17.557 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-01-24T22:02:17.573 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-01-24T22:02:17.612 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjq1:amd64. 2023-01-24T22:02:17.614 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-24T22:02:17.631 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../082-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-24T22:02:17.670 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-24T22:02:17.939 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package jq. 2023-01-24T22:02:17.944 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rsa. 2023-01-24T22:02:17.956 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../083-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-24T22:02:17.960 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../073-python3-rsa_4.0-3_all.deb ... 2023-01-24T22:02:17.997 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-01-24T22:02:18.001 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rsa (4.0-3) ... 2023-01-24T22:02:18.259 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package socat. 2023-01-24T22:02:18.274 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../084-socat_1.7.3.3-2_amd64.deb ... 2023-01-24T22:02:18.316 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking socat (1.7.3.3-2) ... 2023-01-24T22:02:18.331 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-google-auth. 2023-01-24T22:02:18.348 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../074-python3-google-auth_1.5.1-2_all.deb ... 2023-01-24T22:02:18.389 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-01-24T22:02:18.645 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package xmlstarlet. 2023-01-24T22:02:18.664 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-01-24T22:02:18.703 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-01-24T22:02:18.734 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-blinker. 2023-01-24T22:02:18.752 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../075-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-01-24T22:02:18.792 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-24T22:02:19.025 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-test. 2023-01-24T22:02:19.042 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../086-ceph-test_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:19.083 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-test (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:19.128 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-oauthlib. 2023-01-24T22:02:19.147 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../076-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-01-24T22:02:19.186 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-24T22:02:19.507 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-01-24T22:02:19.527 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../077-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-01-24T22:02:19.598 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-24T22:02:19.909 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-websocket. 2023-01-24T22:02:19.930 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../078-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-01-24T22:02:19.967 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-01-24T22:02:20.304 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-kubernetes. 2023-01-24T22:02:20.320 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../079-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-01-24T22:02:20.353 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-01-24T22:02:20.934 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-01-24T22:02:20.954 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../080-ceph-mgr-k8sevents_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:02:20.983 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-k8sevents (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:21.405 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libonig5:amd64. 2023-01-24T22:02:21.423 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../081-libonig5_6.9.4-1_amd64.deb ... 2023-01-24T22:02:21.454 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-01-24T22:02:21.833 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjq1:amd64. 2023-01-24T22:02:21.851 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../082-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-24T22:02:21.891 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-24T22:02:22.160 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package jq. 2023-01-24T22:02:22.179 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../083-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-01-24T22:02:22.218 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-01-24T22:02:22.488 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package socat. 2023-01-24T22:02:22.505 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../084-socat_1.7.3.3-2_amd64.deb ... 2023-01-24T22:02:22.546 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking socat (1.7.3.3-2) ... 2023-01-24T22:02:22.875 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package xmlstarlet. 2023-01-24T22:02:22.892 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-01-24T22:02:22.933 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-01-24T22:02:23.297 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-test. 2023-01-24T22:02:23.315 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../086-ceph-test_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:23.355 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-test (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:24.234 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-volume. 2023-01-24T22:02:24.255 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../087-ceph-volume_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:02:24.292 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-volume (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:24.594 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package fonts-mathjax. 2023-01-24T22:02:24.613 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../088-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-24T22:02:24.653 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-24T22:02:25.220 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libcephfs-dev. 2023-01-24T22:02:25.237 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../089-libcephfs-dev_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:25.277 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libcephfs-dev (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:25.689 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package nvme-cli. 2023-01-24T22:02:25.706 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-01-24T22:02:25.764 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-01-24T22:02:26.110 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjs-mathjax. 2023-01-24T22:02:26.131 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../091-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-24T22:02:26.168 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-24T22:02:27.780 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python-natsort-doc. 2023-01-24T22:02:27.799 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../092-python-natsort-doc_7.0.1-1_all.deb ... 2023-01-24T22:02:27.838 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-01-24T22:02:28.183 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-atomicwrites. 2023-01-24T22:02:28.204 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../093-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-01-24T22:02:28.258 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-01-24T22:02:28.440 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-volume. 2023-01-24T22:02:28.459 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../087-ceph-volume_17.2.5-727-g49f8fb05-1focal_all.deb ... 2023-01-24T22:02:28.507 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-volume (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:28.561 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-attr. 2023-01-24T22:02:28.578 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../094-python3-attr_19.3.0-2_all.deb ... 2023-01-24T22:02:28.619 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-01-24T22:02:28.853 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package fonts-mathjax. 2023-01-24T22:02:28.872 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../088-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-24T22:02:28.911 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-24T22:02:28.963 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-webencodings. 2023-01-24T22:02:28.981 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../095-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-01-24T22:02:29.029 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-24T22:02:29.324 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-html5lib. 2023-01-24T22:02:29.344 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../096-python3-html5lib_1.0.1-2_all.deb ... 2023-01-24T22:02:29.382 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-01-24T22:02:29.466 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libcephfs-dev. 2023-01-24T22:02:29.483 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../089-libcephfs-dev_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:29.549 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libcephfs-dev (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:29.694 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-01-24T22:02:29.710 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../097-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-01-24T22:02:29.743 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-24T22:02:29.967 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package nvme-cli. 2023-01-24T22:02:29.987 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-01-24T22:02:30.044 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-01-24T22:02:30.155 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-packaging. 2023-01-24T22:02:30.176 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../098-python3-packaging_20.3-1_all.deb ... 2023-01-24T22:02:30.205 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-packaging (20.3-1) ... 2023-01-24T22:02:30.402 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjs-mathjax. 2023-01-24T22:02:30.422 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../091-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-01-24T22:02:30.465 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-24T22:02:30.475 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pastescript. 2023-01-24T22:02:30.491 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-4_all.deb ... 2023-01-24T22:02:30.533 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-01-24T22:02:30.853 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pluggy. 2023-01-24T22:02:30.870 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../100-python3-pluggy_0.13.0-2_all.deb ... 2023-01-24T22:02:30.911 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-01-24T22:02:31.239 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-psutil. 2023-01-24T22:02:31.255 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../101-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-01-24T22:02:31.297 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-01-24T22:02:31.626 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-py. 2023-01-24T22:02:31.642 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../102-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-01-24T22:02:31.683 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-01-24T22:02:32.011 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyinotify. 2023-01-24T22:02:32.029 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-01-24T22:02:32.048 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python-natsort-doc. 2023-01-24T22:02:32.066 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../092-python-natsort-doc_7.0.1-1_all.deb ... 2023-01-24T22:02:32.069 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-24T22:02:32.106 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-01-24T22:02:32.355 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-wcwidth. 2023-01-24T22:02:32.376 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../104-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-01-24T22:02:32.413 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-24T22:02:32.442 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-atomicwrites. 2023-01-24T22:02:32.458 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../093-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-01-24T22:02:32.500 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-01-24T22:02:32.743 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pytest. 2023-01-24T22:02:32.761 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../105-python3-pytest_4.6.9-1_all.deb ... 2023-01-24T22:02:32.801 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-01-24T22:02:32.836 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-attr. 2023-01-24T22:02:32.853 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../094-python3-attr_19.3.0-2_all.deb ... 2023-01-24T22:02:32.894 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-01-24T22:02:33.155 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-simplejson. 2023-01-24T22:02:33.172 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../106-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-01-24T22:02:33.213 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-24T22:02:33.247 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webencodings. 2023-01-24T22:02:33.264 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../095-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-01-24T22:02:33.305 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-24T22:02:33.499 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-01-24T22:02:33.517 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../107-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-01-24T22:02:33.557 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-24T22:02:33.600 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-html5lib. 2023-01-24T22:02:33.617 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../096-python3-html5lib_1.0.1-2_all.deb ... 2023-01-24T22:02:33.683 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-01-24T22:02:34.036 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-01-24T22:02:34.053 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../097-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-01-24T22:02:34.116 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-24T22:02:34.286 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package radosgw. 2023-01-24T22:02:34.305 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../108-radosgw_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:34.344 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking radosgw (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:34.606 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-packaging. 2023-01-24T22:02:34.627 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../098-python3-packaging_20.3-1_all.deb ... 2023-01-24T22:02:34.664 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-packaging (20.3-1) ... 2023-01-24T22:02:34.950 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pastescript. 2023-01-24T22:02:34.971 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-4_all.deb ... 2023-01-24T22:02:35.008 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-01-24T22:02:35.362 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pluggy. 2023-01-24T22:02:35.380 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../100-python3-pluggy_0.13.0-2_all.deb ... 2023-01-24T22:02:35.420 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-01-24T22:02:35.765 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-psutil. 2023-01-24T22:02:35.781 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../101-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-01-24T22:02:35.823 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-01-24T22:02:36.039 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package rbd-fuse. 2023-01-24T22:02:36.057 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../109-rbd-fuse_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:36.097 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking rbd-fuse (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:36.184 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-py. 2023-01-24T22:02:36.201 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../102-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-01-24T22:02:36.242 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-01-24T22:02:36.409 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-attr (19.3.0-2) ... 2023-01-24T22:02:36.571 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyinotify. 2023-01-24T22:02:36.588 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-01-24T22:02:36.628 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-24T22:02:36.704 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-01-24T22:02:36.828 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-24T22:02:36.948 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-wcwidth. 2023-01-24T22:02:36.954 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-01-24T22:02:36.965 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../104-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-01-24T22:02:37.006 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-24T22:02:37.164 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up cephadm (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:37.359 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pytest. 2023-01-24T22:02:37.377 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../105-python3-pytest_4.6.9-1_all.deb ... 2023-01-24T22:02:37.418 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-01-24T22:02:37.771 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-simplejson. 2023-01-24T22:02:37.789 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../106-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-01-24T22:02:37.792 INFO:teuthology.orchestra.run.smithi100.stdout:Adding system user cephadm....done 2023-01-24T22:02:37.829 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-24T22:02:37.954 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-24T22:02:38.080 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-24T22:02:38.107 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-01-24T22:02:38.124 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../107-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-01-24T22:02:38.188 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-24T22:02:38.424 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-01-24T22:02:38.717 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-24T22:02:38.843 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-01-24T22:02:38.911 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package radosgw. 2023-01-24T22:02:38.931 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../108-radosgw_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:38.968 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking radosgw (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:38.969 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-01-24T22:02:39.320 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-01-24T22:02:39.764 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-24T22:02:40.056 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-01-24T22:02:40.341 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-24T22:02:40.625 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-24T22:02:40.739 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package rbd-fuse. 2023-01-24T22:02:40.757 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../109-rbd-fuse_17.2.5-727-g49f8fb05-1focal_amd64.deb ... 2023-01-24T22:02:40.797 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking rbd-fuse (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:40.910 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-ceph-argparse (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:41.109 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-attr (19.3.0-2) ... 2023-01-24T22:02:41.202 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-24T22:02:41.328 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-01-24T22:02:41.421 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-01-24T22:02:41.570 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-01-24T22:02:41.621 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-24T22:02:41.688 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-01-24T22:02:41.923 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephadm (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:41.930 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-24T22:02:42.056 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-01-24T22:02:42.416 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-01-24T22:02:42.576 INFO:teuthology.orchestra.run.smithi149.stdout:Adding system user cephadm....done 2023-01-24T22:02:42.701 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-01-24T22:02:42.738 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-01-24T22:02:42.897 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-01-24T22:02:42.976 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-24T22:02:43.274 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-01-24T22:02:43.336 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-01-24T22:02:43.559 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-01-24T22:02:43.620 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-01-24T22:02:43.685 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-01-24T22:02:43.827 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-01-24T22:02:43.955 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-01-24T22:02:44.196 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-01-24T22:02:44.264 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-packaging (20.3-1) ... 2023-01-24T22:02:44.549 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-01-24T22:02:44.675 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-24T22:02:44.689 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-01-24T22:02:44.826 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-24T22:02:44.966 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-01-24T22:02:45.119 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-01-24T22:02:45.250 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-01-24T22:02:45.517 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-01-24T22:02:45.520 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-24T22:02:45.836 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-ceph-argparse (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:45.880 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-24T22:02:46.136 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-01-24T22:02:46.240 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up socat (1.7.3.3-2) ... 2023-01-24T22:02:46.262 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-01-24T22:02:46.391 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-ceph-common (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:46.547 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-01-24T22:02:46.717 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-24T22:02:46.839 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-01-24T22:02:46.852 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-01-24T22:02:46.990 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-01-24T22:02:47.203 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-24T22:02:47.329 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-01-24T22:02:47.392 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-01-24T22:02:47.455 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-01-24T22:02:47.693 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-01-24T22:02:47.748 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-24T22:02:47.977 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-01-24T22:02:48.065 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-24T22:02:48.200 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-24T22:02:48.326 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-01-24T22:02:48.337 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-01-24T22:02:48.630 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-01-24T22:02:48.652 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-01-24T22:02:48.945 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-01-24T22:02:49.014 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-01-24T22:02:49.246 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-24T22:02:49.307 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-packaging (20.3-1) ... 2023-01-24T22:02:49.397 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-01-24T22:02:49.633 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-01-24T22:02:49.681 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-01-24T22:02:49.759 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-01-24T22:02:49.885 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-01-24T22:02:49.983 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-24T22:02:50.170 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-01-24T22:02:50.286 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-01-24T22:02:50.596 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2023-01-24T22:02:50.657 INFO:teuthology.orchestra.run.smithi100.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-01-24T22:02:50.928 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-01-24T22:02:50.990 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-01-24T22:02:51.054 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-24T22:02:51.358 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up socat (1.7.3.3-2) ... 2023-01-24T22:02:51.363 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-01-24T22:02:51.509 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-ceph-common (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:51.715 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-24T22:02:51.818 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-24T22:02:51.849 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-24T22:02:51.975 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-01-24T22:02:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-01-24T22:02:52.326 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-24T22:02:52.354 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-01-24T22:02:52.480 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-01-24T22:02:52.602 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librados2 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:52.606 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-01-24T22:02:52.728 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-01-24T22:02:52.899 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-01-24T22:02:53.242 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-24T22:02:53.368 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-01-24T22:02:53.494 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-01-24T22:02:53.813 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-01-24T22:02:54.117 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-01-24T22:02:54.184 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libsqlite3-mod-ceph (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:54.310 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-24T22:02:54.415 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-01-24T22:02:54.540 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-01-24T22:02:54.842 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-01-24T22:02:54.853 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-01-24T22:02:55.126 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-01-24T22:02:55.221 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-01-24T22:02:55.427 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-01-24T22:02:55.538 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-01-24T22:02:55.823 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-24T22:02:55.827 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-01-24T22:02:55.957 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-01-24T22:02:56.080 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-01-24T22:02:56.206 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-01-24T22:02:56.292 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libcephfs2 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:56.418 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-24T22:02:56.532 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-01-24T22:02:56.745 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libradosstriper1 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:56.871 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-24T22:02:56.883 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-01-24T22:02:57.009 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-01-24T22:02:57.136 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-01-24T22:02:57.197 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-24T22:02:57.470 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-01-24T22:02:57.773 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librados2 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:57.897 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-01-24T22:02:58.252 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librbd1 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:58.378 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-24T22:02:58.504 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-01-24T22:02:58.647 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-01-24T22:02:58.772 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rsa (4.0-3) ... 2023-01-24T22:02:59.065 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-24T22:02:59.200 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-01-24T22:02:59.361 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libsqlite3-mod-ceph (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:59.487 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-01-24T22:02:59.509 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-modules-core (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:59.632 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-fuse (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:02:59.730 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-01-24T22:02:59.857 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-24T22:02:59.857 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-24T22:03:00.335 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libcephfs-dev (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:00.423 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-01-24T22:03:00.538 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-24T22:03:00.724 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-01-24T22:03:00.839 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-01-24T22:03:01.034 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-01-24T22:03:01.149 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-01-24T22:03:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-01-24T22:03:01.511 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libcephfs2 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:01.518 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rados (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:01.636 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librgw2 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:01.637 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-01-24T22:03:01.779 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rbd (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:01.905 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up rbd-fuse (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:01.964 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libradosstriper1 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:02.031 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-routes (2.4.1-2) ... 2023-01-24T22:03:02.090 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-01-24T22:03:02.324 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-01-24T22:03:02.416 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-01-24T22:03:02.609 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rgw (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:02.735 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cephfs (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:02.861 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-01-24T22:03:03.438 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librbd1 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:03.564 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-01-24T22:03:03.713 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-01-24T22:03:03.756 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-common (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:03.840 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-01-24T22:03:03.959 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rsa (4.0-3) ... 2023-01-24T22:03:04.259 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-01-24T22:03:04.321 INFO:teuthology.orchestra.run.smithi100.stdout:Adding group ceph....done 2023-01-24T22:03:04.385 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-01-24T22:03:04.686 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-modules-core (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:04.688 INFO:teuthology.orchestra.run.smithi100.stdout:Adding system user ceph....done 2023-01-24T22:03:04.812 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-fuse (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:04.898 INFO:teuthology.orchestra.run.smithi100.stdout:Setting system user ceph properties....done 2023-01-24T22:03:04.922 INFO:teuthology.orchestra.run.smithi100.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-01-24T22:03:05.052 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-24T22:03:05.053 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-01-24T22:03:05.070 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-01-24T22:03:05.393 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-01-24T22:03:05.539 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libcephfs-dev (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:05.759 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-01-24T22:03:05.860 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-test (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:06.003 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up radosgw (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:06.273 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-24T22:03:06.273 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-24T22:03:06.345 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-01-24T22:03:06.755 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-01-24T22:03:07.048 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-base (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:07.141 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rados (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:07.300 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librgw2 (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:07.424 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-01-24T22:03:07.426 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rbd (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:07.552 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up rbd-fuse (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:07.679 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-routes (2.4.1-2) ... 2023-01-24T22:03:07.883 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mds (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:07.999 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-01-24T22:03:08.114 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-24T22:03:08.115 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-24T22:03:08.294 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rgw (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:08.422 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cephfs (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:08.531 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-01-24T22:03:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:08.775 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-24T22:03:08.775 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-24T22:03:09.245 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-osd (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:09.475 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-common (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:09.770 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-24T22:03:09.771 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-24T22:03:10.061 INFO:teuthology.orchestra.run.smithi149.stdout:Adding group ceph....done 2023-01-24T22:03:10.257 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-k8sevents (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:10.471 INFO:teuthology.orchestra.run.smithi149.stdout:Adding system user ceph....done 2023-01-24T22:03:10.507 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-diskprediction-local (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:10.623 INFO:teuthology.orchestra.run.smithi149.stdout:Setting system user ceph properties....done 2023-01-24T22:03:10.642 INFO:teuthology.orchestra.run.smithi149.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-01-24T22:03:10.649 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mon (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:10.790 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-01-24T22:03:10.883 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-24T22:03:10.884 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-24T22:03:11.136 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-01-24T22:03:11.334 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-cephadm (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:11.477 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:11.603 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-dashboard (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:11.619 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-test (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:11.746 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-volume (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:11.754 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up radosgw (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:11.872 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-01-24T22:03:12.024 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-01-24T22:03:12.050 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-24T22:03:12.050 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-01-24T22:03:12.317 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-01-24T22:03:12.723 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-base (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:13.086 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-01-24T22:03:13.541 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mds (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:13.773 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-24T22:03:13.773 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-01-24T22:03:14.218 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:14.446 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-24T22:03:14.447 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-01-24T22:03:14.878 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-osd (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:15.153 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-01-24T22:03:15.415 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-24T22:03:15.415 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-01-24T22:03:15.765 INFO:teuthology.orchestra.run.smithi100.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-01-24T22:03:15.768 DEBUG:teuthology.parallel:result is None 2023-01-24T22:03:15.889 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-k8sevents (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:16.015 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-diskprediction-local (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:16.157 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mon (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:16.381 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-24T22:03:16.382 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-01-24T22:03:16.825 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-cephadm (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:16.968 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:17.094 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-dashboard (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:17.262 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-volume (17.2.5-727-g49f8fb05-1focal) ... 2023-01-24T22:03:17.389 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-01-24T22:03:17.541 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-01-24T22:03:17.835 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-01-24T22:03:20.578 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-01-24T22:03:21.190 INFO:teuthology.orchestra.run.smithi149.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-01-24T22:03:21.193 DEBUG:teuthology.parallel:result is None 2023-01-24T22:03:21.193 DEBUG:teuthology.orchestra.run.smithi100:> sudo lsb_release -is 2023-01-24T22:03:21.243 INFO:teuthology.orchestra.run.smithi100.stdout:Ubuntu 2023-01-24T22:03:21.248 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-24T22:03:21.249 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=49f8fb05584886826e8eade75f7105fba754560c 2023-01-24T22:03:21.402 DEBUG:teuthology.orchestra.run.smithi100:> dpkg-query -W -f '${Version}' ceph 2023-01-24T22:03:21.427 INFO:teuthology.orchestra.run.smithi100.stdout:17.2.5-727-g49f8fb05-1focal 2023-01-24T22:03:21.428 INFO:teuthology.packaging:The installed version of ceph is 17.2.5-727-g49f8fb05-1focal 2023-01-24T22:03:21.429 INFO:teuthology.task.install:The correct ceph version 17.2.5-727-g49f8fb05-1focal is installed. 2023-01-24T22:03:21.429 DEBUG:teuthology.orchestra.run.smithi149:> sudo lsb_release -is 2023-01-24T22:03:21.481 INFO:teuthology.orchestra.run.smithi149.stdout:Ubuntu 2023-01-24T22:03:21.487 DEBUG:teuthology.misc:System to be installed: Ubuntu 2023-01-24T22:03:21.487 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=49f8fb05584886826e8eade75f7105fba754560c 2023-01-24T22:03:21.634 DEBUG:teuthology.orchestra.run.smithi149:> dpkg-query -W -f '${Version}' ceph 2023-01-24T22:03:21.658 INFO:teuthology.orchestra.run.smithi149.stdout:17.2.5-727-g49f8fb05-1focal 2023-01-24T22:03:21.658 INFO:teuthology.packaging:The installed version of ceph is 17.2.5-727-g49f8fb05-1focal 2023-01-24T22:03:21.658 INFO:teuthology.task.install:The correct ceph version 17.2.5-727-g49f8fb05-1focal is installed. 2023-01-24T22:03:21.659 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-24T22:03:21.659 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:21.660 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-24T22:03:21.675 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:21.675 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-24T22:03:21.716 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-24T22:03:21.716 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:21.716 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2023-01-24T22:03:21.733 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-24T22:03:21.786 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:21.787 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2023-01-24T22:03:21.802 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-24T22:03:21.859 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-24T22:03:21.860 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:21.860 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-24T22:03:21.875 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-24T22:03:21.885 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:21.886 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-24T22:03:21.900 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-24T22:03:21.960 INFO:teuthology.run_tasks:Running task ceph... 2023-01-24T22:03:22.030 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-01-24T22:03:22.031 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2023-01-24T22:03:22.033 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2023-01-24T22:03:22.049 INFO:tasks.ceph:Disabling ceph logrotate... 2023-01-24T22:03:22.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-24T22:03:22.087 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-24T22:03:22.107 INFO:tasks.ceph:Creating extra log directories... 2023-01-24T22:03:22.108 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-24T22:03:22.110 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-24T22:03:22.137 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-01-24T22:03:22.138 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'filestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon election default strategy': 1, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_async_recovery_min_cost': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'must scrub before tier agent can activate'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-01-24T22:03:22.138 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi/7135861', 'branch': 'wip-yuri7-testing-2023-01-23-1532-quincy', 'description': 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy}', 'email': 'yweinstein@radhat.com', 'first_in_suite': False, 'job_id': '7135861', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-01-24_16:05:13-rados-wip-yuri7-testing-2023-01-23-1532-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri7-testing-2023-01-23-1532-quincy'}, 'ceph': {'conf': {'global': {'mon election default strategy': 1, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_async_recovery_min_cost': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'filestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'must scrub before tier agent can activate'], 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'}}, 'workunit': {'branch': 'wip-yuri7-testing-2023-01-23-1532-quincy', 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '49f8fb05584886826e8eade75f7105fba754560c', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri7-testing-2023-01-23-1532-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_49f8fb05584886826e8eade75f7105fba754560c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '49f8fb05584886826e8eade75f7105fba754560c', 'targets': {'smithi100.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=', 'smithi149.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'filestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon election default strategy': 1, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_async_recovery_min_cost': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'must scrub before tier agent can activate'], 'sha1': '49f8fb05584886826e8eade75f7105fba754560c', 'cluster': 'ceph'}}, {'exec': {'mon.a': ['while ! ceph balancer status ; do sleep 1 ; done', 'ceph balancer mode crush-compat', 'ceph balancer on']}}, {'thrashosds': {'chance_pgnum_grow': 0.25, 'chance_pgnum_shrink': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800}}, {'exec': {'client.0': ['sudo ceph osd pool create base 4', 'sudo ceph osd pool application enable base rados', 'sudo ceph osd pool create cache 4', 'sudo ceph osd tier add base cache', 'sudo ceph osd tier cache-mode cache readproxy', 'sudo ceph osd tier set-overlay base cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 3600', 'sudo ceph osd pool set cache target_max_objects 250']}}, {'rados': {'clients': ['client.0'], 'objects': 500, 'op_weights': {'cache_evict': 50, 'cache_flush': 50, 'cache_try_flush': 50, 'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000, 'pool_snaps': True, 'pools': ['base']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8e1bba12e584b7ae912e92e94afe9c075ab51fa3', 'timestamp': '2023-01-24_16:05:13', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.17735'} 2023-01-24T22:03:22.139 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-24T22:03:22.142 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-24T22:03:22.149 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2023-01-24T22:03:22.191 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2023-01-24T22:03:22.208 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:22.208 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2023-01-24T22:03:22.213 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-24T22:03:22.213 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2023-01-24T22:03:22.219 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-24T22:03:22.219 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-24T22:03:22.220 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 360 Links: 1 2023-01-24T22:03:22.220 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-24T22:03:22.220 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-01-24 21:59:55.841492502 +0000 2023-01-24T22:03:22.220 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-01-24 21:59:55.537499505 +0000 2023-01-24T22:03:22.220 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-01-24 21:59:55.537499505 +0000 2023-01-24T22:03:22.221 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2023-01-24T22:03:22.221 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-24T22:03:22.275 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-01-24T22:03:22.276 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-01-24T22:03:22.276 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000420364 s, 1.2 MB/s 2023-01-24T22:03:22.277 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-24T22:03:22.287 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2023-01-24T22:03:22.294 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-24T22:03:22.295 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-24T22:03:22.295 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-01-24T22:03:22.295 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-24T22:03:22.295 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-01-24 21:59:56.085486880 +0000 2023-01-24T22:03:22.295 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-01-24 21:59:56.081486973 +0000 2023-01-24T22:03:22.296 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-01-24 21:59:56.081486973 +0000 2023-01-24T22:03:22.296 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2023-01-24T22:03:22.296 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-24T22:03:22.349 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-01-24T22:03:22.350 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-01-24T22:03:22.350 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000360022 s, 1.4 MB/s 2023-01-24T22:03:22.351 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-24T22:03:22.361 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2023-01-24T22:03:22.367 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-24T22:03:22.367 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-24T22:03:22.368 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-01-24T22:03:22.368 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-24T22:03:22.368 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-01-24 21:59:56.893468265 +0000 2023-01-24T22:03:22.368 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-01-24 21:59:56.605474900 +0000 2023-01-24T22:03:22.369 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-01-24 21:59:56.605474900 +0000 2023-01-24T22:03:22.369 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2023-01-24T22:03:22.370 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-24T22:03:22.382 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-01-24T22:03:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-01-24T22:03:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000397597 s, 1.3 MB/s 2023-01-24T22:03:22.384 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-24T22:03:22.433 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2023-01-24T22:03:22.441 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-24T22:03:22.442 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-24T22:03:22.442 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 380 Links: 1 2023-01-24T22:03:22.442 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-24T22:03:22.442 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-01-24 21:59:57.425456009 +0000 2023-01-24T22:03:22.442 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-01-24 21:59:57.129462828 +0000 2023-01-24T22:03:22.443 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-01-24 21:59:57.129462828 +0000 2023-01-24T22:03:22.443 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2023-01-24T22:03:22.443 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-24T22:03:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-01-24T22:03:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-01-24T22:03:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000412861 s, 1.2 MB/s 2023-01-24T22:03:22.458 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-24T22:03:22.510 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-24T22:03:22.510 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:22.511 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2023-01-24T22:03:22.518 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-24T22:03:22.518 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2023-01-24T22:03:22.567 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-24T22:03:22.568 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-24T22:03:22.568 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-01-24T22:03:22.568 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-24T22:03:22.569 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-01-24 21:59:55.841037296 +0000 2023-01-24T22:03:22.569 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-24 21:59:55.537044308 +0000 2023-01-24T22:03:22.569 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-24 21:59:55.537044308 +0000 2023-01-24T22:03:22.569 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-01-24T22:03:22.570 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-24T22:03:22.581 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-01-24T22:03:22.582 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-01-24T22:03:22.582 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000413017 s, 1.2 MB/s 2023-01-24T22:03:22.583 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-24T22:03:22.633 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2023-01-24T22:03:22.641 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-24T22:03:22.642 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-24T22:03:22.642 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-01-24T22:03:22.642 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-24T22:03:22.642 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-01-24 21:59:56.365025210 +0000 2023-01-24T22:03:22.643 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-24 21:59:56.049032498 +0000 2023-01-24T22:03:22.643 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-24 21:59:56.049032498 +0000 2023-01-24T22:03:22.643 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-01-24T22:03:22.643 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-24T22:03:22.657 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-01-24T22:03:22.658 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-01-24T22:03:22.658 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000397645 s, 1.3 MB/s 2023-01-24T22:03:22.660 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-24T22:03:22.709 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2023-01-24T22:03:22.717 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-24T22:03:22.717 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-24T22:03:22.717 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-01-24T22:03:22.717 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-24T22:03:22.718 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-01-24 21:59:56.877013400 +0000 2023-01-24T22:03:22.718 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-24 21:59:56.585020135 +0000 2023-01-24T22:03:22.718 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-24 21:59:56.585020135 +0000 2023-01-24T22:03:22.718 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-01-24T22:03:22.719 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-24T22:03:22.731 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-01-24T22:03:22.732 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-01-24T22:03:22.732 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.00037672 s, 1.4 MB/s 2023-01-24T22:03:22.733 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-24T22:03:22.741 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2023-01-24T22:03:22.747 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-24T22:03:22.747 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-24T22:03:22.748 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 377 Links: 1 2023-01-24T22:03:22.748 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-24T22:03:22.748 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-01-24 21:59:57.381001774 +0000 2023-01-24T22:03:22.749 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-24 21:59:57.117007864 +0000 2023-01-24T22:03:22.749 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-24 21:59:57.117007864 +0000 2023-01-24T22:03:22.749 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-01-24T22:03:22.749 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-24T22:03:22.805 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-01-24T22:03:22.806 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-01-24T22:03:22.806 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000409298 s, 1.3 MB/s 2023-01-24T22:03:22.807 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-24T22:03:22.815 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-24T22:03:22.816 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-24T22:03:22.816 INFO:tasks.ceph:Generating config... 2023-01-24T22:03:22.818 INFO:tasks.ceph:[osd] debug monc = 20 2023-01-24T22:03:22.819 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-01-24T22:03:22.819 INFO:tasks.ceph:[osd] debug ms = 1 2023-01-24T22:03:22.820 INFO:tasks.ceph:[osd] debug osd = 20 2023-01-24T22:03:22.820 INFO:tasks.ceph:[osd] osd backoff on degraded = True 2023-01-24T22:03:22.821 INFO:tasks.ceph:[osd] osd backoff on peering = True 2023-01-24T22:03:22.821 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-01-24T22:03:22.821 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-01-24T22:03:22.821 INFO:tasks.ceph:[osd] osd inject bad map crc probability = 0.1 2023-01-24T22:03:22.822 INFO:tasks.ceph:[osd] osd map cache size = 1 2023-01-24T22:03:22.822 INFO:tasks.ceph:[osd] osd max backfills = 6 2023-01-24T22:03:22.822 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-01-24T22:03:22.823 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-01-24T22:03:22.823 INFO:tasks.ceph:[osd] osd objectstore = filestore 2023-01-24T22:03:22.823 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-01-24T22:03:22.824 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-01-24T22:03:22.824 INFO:tasks.ceph:[osd] osd scrub during recovery = False 2023-01-24T22:03:22.824 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2023-01-24T22:03:22.825 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2023-01-24T22:03:22.825 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-01-24T22:03:22.825 INFO:tasks.ceph:[osd] osd sloppy crc = True 2023-01-24T22:03:22.825 INFO:tasks.ceph:[osd] osd_max_pg_log_entries = 3000 2023-01-24T22:03:22.826 INFO:tasks.ceph:[osd] osd_min_pg_log_entries = 3000 2023-01-24T22:03:22.826 INFO:tasks.ceph:[global] mon election default strategy = 1 2023-01-24T22:03:22.826 INFO:tasks.ceph:[global] ms type = async 2023-01-24T22:03:22.826 INFO:tasks.ceph:[global] osd debug inject dispatch delay duration = 0.1 2023-01-24T22:03:22.827 INFO:tasks.ceph:[global] osd debug inject dispatch delay probability = 0.1 2023-01-24T22:03:22.827 INFO:tasks.ceph:[global] osd_async_recovery_min_cost = 1 2023-01-24T22:03:22.827 INFO:tasks.ceph:[global] osd_object_clean_region_max_num_intervals = 1000 2023-01-24T22:03:22.828 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2023-01-24T22:03:22.828 INFO:tasks.ceph:[global] osd_pool_default_size = 2 2023-01-24T22:03:22.828 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-01-24T22:03:22.829 INFO:tasks.ceph:[mgr] debug ms = 1 2023-01-24T22:03:22.829 INFO:tasks.ceph:[mon] debug mon = 20 2023-01-24T22:03:22.829 INFO:tasks.ceph:[mon] debug ms = 1 2023-01-24T22:03:22.830 INFO:tasks.ceph:[mon] debug paxos = 20 2023-01-24T22:03:22.830 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-01-24T22:03:22.830 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-01-24T22:03:22.831 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-01-24T22:03:22.831 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-01-24T22:03:22.831 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-01-24T22:03:22.831 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-01-24T22:03:22.832 INFO:tasks.ceph:Setting up mon.a... 2023-01-24T22:03:22.832 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-01-24T22:03:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.keyring 2023-01-24T22:03:22.868 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-01-24T22:03:22.904 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-24T22:03:22.961 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.100'), ('mon.c', '[v2:172.21.15.100:3301,v1:172.21.15.100:6790]'), ('mon.b', '172.21.15.149')] 2023-01-24T22:03:22.962 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.100,[v2:172.21.15.100:3301,v1:172.21.15.100:6790],172.21.15.149', 'mon election default strategy': 1, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_async_recovery_min_cost': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'filestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-01-24T22:03:22.962 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:22.963 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-01-24T22:03:22.970 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.100 --addv c '[v2:172.21.15.100:3301,v1:172.21.15.100:6790]' --add b 172.21.15.149 --print /home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:23.008 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:23.009 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: generated fsid 2db70b95-3a95-440a-afc1-b7f5c81bdc31 2023-01-24T22:03:23.009 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = octopus 2023-01-24T22:03:23.009 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 0 2023-01-24T22:03:23.010 INFO:teuthology.orchestra.run.smithi100.stdout:fsid 2db70b95-3a95-440a-afc1-b7f5c81bdc31 2023-01-24T22:03:23.010 INFO:teuthology.orchestra.run.smithi100.stdout:last_changed 2023-01-24T22:03:23.006196+0000 2023-01-24T22:03:23.010 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-01-24T22:03:23.006196+0000 2023-01-24T22:03:23.010 INFO:teuthology.orchestra.run.smithi100.stdout:min_mon_release 15 (octopus) 2023-01-24T22:03:23.010 INFO:teuthology.orchestra.run.smithi100.stdout:election_strategy: 1 2023-01-24T22:03:23.011 INFO:teuthology.orchestra.run.smithi100.stdout:0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2023-01-24T22:03:23.011 INFO:teuthology.orchestra.run.smithi100.stdout:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2023-01-24T22:03:23.011 INFO:teuthology.orchestra.run.smithi100.stdout:2: [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] mon.c 2023-01-24T22:03:23.011 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-01-24T22:03:23.012 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-01-24T22:03:23.059 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2db70b95-3a95-440a-afc1-b7f5c81bdc31... 2023-01-24T22:03:23.061 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-24T22:03:23.064 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-24T22:03:23.099 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2023-01-24T22:03:23.099 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2023-01-24T22:03:23.099 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-24T22:03:23.099 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2023-01-24T22:03:23.100 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.100 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2023-01-24T22:03:23.100 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.100 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2023-01-24T22:03:23.100 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.101 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2023-01-24T22:03:23.101 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2023-01-24T22:03:23.101 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.101 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2023-01-24T22:03:23.101 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2023-01-24T22:03:23.102 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.102 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-24T22:03:23.102 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2023-01-24T22:03:23.102 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.102 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2023-01-24T22:03:23.103 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-24T22:03:23.103 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.103 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2023-01-24T22:03:23.103 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.103 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2023-01-24T22:03:23.104 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2023-01-24T22:03:23.104 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2023-01-24T22:03:23.104 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2023-01-24T22:03:23.104 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2023-01-24T22:03:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2023-01-24T22:03:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2023-01-24T22:03:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-24T22:03:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-24T22:03:23.105 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2023-01-24T22:03:23.106 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.106 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-24T22:03:23.106 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.106 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2023-01-24T22:03:23.106 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.107 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2023-01-24T22:03:23.107 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.107 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2023-01-24T22:03:23.107 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2023-01-24T22:03:23.107 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2023-01-24T22:03:23.108 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.100,[v2:172.21.15.100:3301,v1:172.21.15.100:6790],172.21.15.149" 2023-01-24T22:03:23.108 INFO:teuthology.orchestra.run.smithi100.stdout: mon election default strategy = 1 2023-01-24T22:03:23.108 INFO:teuthology.orchestra.run.smithi100.stdout: ms type = async 2023-01-24T22:03:23.108 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug inject dispatch delay duration = 0.1 2023-01-24T22:03:23.108 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug inject dispatch delay probability = 0.1 2023-01-24T22:03:23.109 INFO:teuthology.orchestra.run.smithi100.stdout: osd_async_recovery_min_cost = 1 2023-01-24T22:03:23.109 INFO:teuthology.orchestra.run.smithi100.stdout: osd_object_clean_region_max_num_intervals = 1000 2023-01-24T22:03:23.109 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_min_size = 2 2023-01-24T22:03:23.109 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_size = 2 2023-01-24T22:03:23.109 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 2db70b95-3a95-440a-afc1-b7f5c81bdc31 2023-01-24T22:03:23.110 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.110 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2023-01-24T22:03:23.110 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2023-01-24T22:03:23.110 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.110 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2023-01-24T22:03:23.111 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 120 2023-01-24T22:03:23.111 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.111 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2023-01-24T22:03:23.111 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2023-01-24T22:03:23.111 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.112 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2023-01-24T22:03:23.112 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2023-01-24T22:03:23.112 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2023-01-24T22:03:23.112 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.112 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2023-01-24T22:03:23.113 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2023-01-24T22:03:23.113 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.113 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2023-01-24T22:03:23.113 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.113 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2023-01-24T22:03:23.114 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.114 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2023-01-24T22:03:23.114 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.114 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2023-01-24T22:03:23.114 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2023-01-24T22:03:23.115 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.115 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2023-01-24T22:03:23.115 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2023-01-24T22:03:23.115 INFO:teuthology.orchestra.run.smithi100.stdout: debug monc = 20 2023-01-24T22:03:23.115 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore zero block detection = True 2023-01-24T22:03:23.115 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-01-24T22:03:23.116 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2023-01-24T22:03:23.116 INFO:teuthology.orchestra.run.smithi100.stdout: osd backoff on degraded = True 2023-01-24T22:03:23.116 INFO:teuthology.orchestra.run.smithi100.stdout: osd backoff on peering = True 2023-01-24T22:03:23.116 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify cached snaps = True 2023-01-24T22:03:23.117 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify missing on start = True 2023-01-24T22:03:23.117 INFO:teuthology.orchestra.run.smithi100.stdout: osd inject bad map crc probability = 0.1 2023-01-24T22:03:23.117 INFO:teuthology.orchestra.run.smithi100.stdout: osd map cache size = 1 2023-01-24T22:03:23.117 INFO:teuthology.orchestra.run.smithi100.stdout: osd max backfills = 6 2023-01-24T22:03:23.117 INFO:teuthology.orchestra.run.smithi100.stdout: osd max markdown count = 1000 2023-01-24T22:03:23.118 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock override recovery settings = True 2023-01-24T22:03:23.118 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = filestore 2023-01-24T22:03:23.118 INFO:teuthology.orchestra.run.smithi100.stdout: osd op queue = debug_random 2023-01-24T22:03:23.118 INFO:teuthology.orchestra.run.smithi100.stdout: osd op queue cut off = debug_random 2023-01-24T22:03:23.118 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub during recovery = False 2023-01-24T22:03:23.119 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub min interval = 60 2023-01-24T22:03:23.120 INFO:teuthology.orchestra.run.smithi100.stdout: osd shutdown pgref assert = True 2023-01-24T22:03:23.120 INFO:teuthology.orchestra.run.smithi100.stdout: osd sloppy crc = True 2023-01-24T22:03:23.120 INFO:teuthology.orchestra.run.smithi100.stdout: osd_max_pg_log_entries = 3000 2023-01-24T22:03:23.120 INFO:teuthology.orchestra.run.smithi100.stdout: osd_min_pg_log_entries = 3000 2023-01-24T22:03:23.120 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.121 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2023-01-24T22:03:23.121 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-01-24T22:03:23.121 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2023-01-24T22:03:23.121 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2023-01-24T22:03:23.121 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2023-01-24T22:03:23.121 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2023-01-24T22:03:23.122 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2023-01-24T22:03:23.122 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2023-01-24T22:03:23.122 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.122 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2023-01-24T22:03:23.122 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-01-24T22:03:23.123 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2023-01-24T22:03:23.123 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2023-01-24T22:03:23.123 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2023-01-24T22:03:23.123 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2023-01-24T22:03:23.123 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2023-01-24T22:03:23.124 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2023-01-24T22:03:23.124 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2023-01-24T22:03:23.124 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2023-01-24T22:03:23.124 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2023-01-24T22:03:23.124 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.125 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-24T22:03:23.125 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2023-01-24T22:03:23.125 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2023-01-24T22:03:23.125 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.125 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2023-01-24T22:03:23.126 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-24T22:03:23.126 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-24T22:03:23.126 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.126 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2023-01-24T22:03:23.126 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2023-01-24T22:03:23.127 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.127 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2023-01-24T22:03:23.127 INFO:teuthology.orchestra.run.smithi100.stdout: mon min osdmap epochs = 50 2023-01-24T22:03:23.127 INFO:teuthology.orchestra.run.smithi100.stdout: mon osdmap full prune interval = 2 2023-01-24T22:03:23.127 INFO:teuthology.orchestra.run.smithi100.stdout: mon osdmap full prune min = 15 2023-01-24T22:03:23.128 INFO:teuthology.orchestra.run.smithi100.stdout: mon osdmap full prune txsize = 2 2023-01-24T22:03:23.128 INFO:teuthology.orchestra.run.smithi100.stdout: mon scrub interval = 300 2023-01-24T22:03:23.128 INFO:teuthology.orchestra.run.smithi100.stdout: paxos service trim min = 10 2023-01-24T22:03:23.128 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:23.128 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2023-01-24T22:03:23.129 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2023-01-24T22:03:23.129 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2023-01-24T22:03:23.129 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2023-01-24T22:03:23.129 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-24T22:03:23.129 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-24T22:03:23.130 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2023-01-24T22:03:23.130 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2023-01-24T22:03:23.130 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2023-01-24T22:03:23.132 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2023-01-24T22:03:23.132 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2023-01-24T22:03:23.132 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-24T22:03:23.132 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2023-01-24T22:03:23.132 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.133 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2023-01-24T22:03:23.133 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.133 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2023-01-24T22:03:23.133 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.133 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2023-01-24T22:03:23.134 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2023-01-24T22:03:23.134 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.134 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2023-01-24T22:03:23.134 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2023-01-24T22:03:23.134 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.135 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-24T22:03:23.135 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2023-01-24T22:03:23.135 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.135 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2023-01-24T22:03:23.135 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-24T22:03:23.136 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.136 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2023-01-24T22:03:23.136 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.136 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2023-01-24T22:03:23.136 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2023-01-24T22:03:23.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2023-01-24T22:03:23.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2023-01-24T22:03:23.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2023-01-24T22:03:23.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2023-01-24T22:03:23.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2023-01-24T22:03:23.138 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-24T22:03:23.138 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-24T22:03:23.138 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2023-01-24T22:03:23.138 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.138 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-24T22:03:23.139 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.139 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2023-01-24T22:03:23.139 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.139 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2023-01-24T22:03:23.139 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.140 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2023-01-24T22:03:23.140 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2023-01-24T22:03:23.140 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2023-01-24T22:03:23.140 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.100,[v2:172.21.15.100:3301,v1:172.21.15.100:6790],172.21.15.149" 2023-01-24T22:03:23.140 INFO:teuthology.orchestra.run.smithi149.stdout: mon election default strategy = 1 2023-01-24T22:03:23.141 INFO:teuthology.orchestra.run.smithi149.stdout: ms type = async 2023-01-24T22:03:23.141 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug inject dispatch delay duration = 0.1 2023-01-24T22:03:23.141 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug inject dispatch delay probability = 0.1 2023-01-24T22:03:23.141 INFO:teuthology.orchestra.run.smithi149.stdout: osd_async_recovery_min_cost = 1 2023-01-24T22:03:23.141 INFO:teuthology.orchestra.run.smithi149.stdout: osd_object_clean_region_max_num_intervals = 1000 2023-01-24T22:03:23.142 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_min_size = 2 2023-01-24T22:03:23.142 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_size = 2 2023-01-24T22:03:23.142 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 2db70b95-3a95-440a-afc1-b7f5c81bdc31 2023-01-24T22:03:23.142 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.142 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2023-01-24T22:03:23.143 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2023-01-24T22:03:23.143 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.143 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2023-01-24T22:03:23.143 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 120 2023-01-24T22:03:23.143 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.144 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2023-01-24T22:03:23.144 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2023-01-24T22:03:23.144 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.144 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2023-01-24T22:03:23.144 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2023-01-24T22:03:23.145 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2023-01-24T22:03:23.145 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.145 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2023-01-24T22:03:23.145 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2023-01-24T22:03:23.145 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.146 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2023-01-24T22:03:23.146 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.146 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2023-01-24T22:03:23.146 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.146 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2023-01-24T22:03:23.147 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.147 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2023-01-24T22:03:23.147 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2023-01-24T22:03:23.147 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.147 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2023-01-24T22:03:23.148 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2023-01-24T22:03:23.148 INFO:teuthology.orchestra.run.smithi149.stdout: debug monc = 20 2023-01-24T22:03:23.148 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore zero block detection = True 2023-01-24T22:03:23.148 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-01-24T22:03:23.148 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2023-01-24T22:03:23.149 INFO:teuthology.orchestra.run.smithi149.stdout: osd backoff on degraded = True 2023-01-24T22:03:23.149 INFO:teuthology.orchestra.run.smithi149.stdout: osd backoff on peering = True 2023-01-24T22:03:23.149 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify cached snaps = True 2023-01-24T22:03:23.149 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify missing on start = True 2023-01-24T22:03:23.149 INFO:teuthology.orchestra.run.smithi149.stdout: osd inject bad map crc probability = 0.1 2023-01-24T22:03:23.150 INFO:teuthology.orchestra.run.smithi149.stdout: osd map cache size = 1 2023-01-24T22:03:23.150 INFO:teuthology.orchestra.run.smithi149.stdout: osd max backfills = 6 2023-01-24T22:03:23.150 INFO:teuthology.orchestra.run.smithi149.stdout: osd max markdown count = 1000 2023-01-24T22:03:23.150 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock override recovery settings = True 2023-01-24T22:03:23.150 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = filestore 2023-01-24T22:03:23.151 INFO:teuthology.orchestra.run.smithi149.stdout: osd op queue = debug_random 2023-01-24T22:03:23.151 INFO:teuthology.orchestra.run.smithi149.stdout: osd op queue cut off = debug_random 2023-01-24T22:03:23.151 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub during recovery = False 2023-01-24T22:03:23.151 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub min interval = 60 2023-01-24T22:03:23.151 INFO:teuthology.orchestra.run.smithi149.stdout: osd shutdown pgref assert = True 2023-01-24T22:03:23.152 INFO:teuthology.orchestra.run.smithi149.stdout: osd sloppy crc = True 2023-01-24T22:03:23.152 INFO:teuthology.orchestra.run.smithi149.stdout: osd_max_pg_log_entries = 3000 2023-01-24T22:03:23.152 INFO:teuthology.orchestra.run.smithi149.stdout: osd_min_pg_log_entries = 3000 2023-01-24T22:03:23.152 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.152 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2023-01-24T22:03:23.153 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-01-24T22:03:23.153 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2023-01-24T22:03:23.153 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-01-24T22:03:23.153 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-01-24T22:03:23.154 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-01-24T22:03:23.154 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-01-24T22:03:23.154 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2023-01-24T22:03:23.154 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.154 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2023-01-24T22:03:23.155 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-01-24T22:03:23.155 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-01-24T22:03:23.155 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2023-01-24T22:03:23.155 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-01-24T22:03:23.155 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2023-01-24T22:03:23.156 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2023-01-24T22:03:23.156 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-01-24T22:03:23.156 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2023-01-24T22:03:23.156 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2023-01-24T22:03:23.156 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-01-24T22:03:23.157 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.157 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-24T22:03:23.157 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2023-01-24T22:03:23.157 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2023-01-24T22:03:23.157 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.157 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2023-01-24T22:03:23.158 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-24T22:03:23.158 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-24T22:03:23.158 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.158 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2023-01-24T22:03:23.158 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2023-01-24T22:03:23.159 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.159 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2023-01-24T22:03:23.159 INFO:teuthology.orchestra.run.smithi149.stdout: mon min osdmap epochs = 50 2023-01-24T22:03:23.159 INFO:teuthology.orchestra.run.smithi149.stdout: mon osdmap full prune interval = 2 2023-01-24T22:03:23.159 INFO:teuthology.orchestra.run.smithi149.stdout: mon osdmap full prune min = 15 2023-01-24T22:03:23.160 INFO:teuthology.orchestra.run.smithi149.stdout: mon osdmap full prune txsize = 2 2023-01-24T22:03:23.160 INFO:teuthology.orchestra.run.smithi149.stdout: mon scrub interval = 300 2023-01-24T22:03:23.160 INFO:teuthology.orchestra.run.smithi149.stdout: paxos service trim min = 10 2023-01-24T22:03:23.160 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-24T22:03:23.160 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2023-01-24T22:03:23.161 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2023-01-24T22:03:23.161 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2023-01-24T22:03:23.161 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2023-01-24T22:03:23.161 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-24T22:03:23.161 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-24T22:03:23.161 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2023-01-24T22:03:23.162 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2023-01-24T22:03:23.162 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2023-01-24T22:03:23.162 INFO:tasks.ceph:Creating admin key on mon.a... 2023-01-24T22:03:23.163 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-01-24T22:03:23.224 INFO:tasks.ceph:Copying monmap to all nodes... 2023-01-24T22:03:23.224 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:23.224 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-01-24T22:03:23.232 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:23.232 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-01-24T22:03:23.236 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2023-01-24T22:03:23.237 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:23.237 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-24T22:03:23.238 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-24T22:03:23.302 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:23.303 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:23.309 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2023-01-24T22:03:23.310 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:23.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-24T22:03:23.311 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-24T22:03:23.337 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:23.337 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:23.342 INFO:tasks.ceph:Setting up mon nodes... 2023-01-24T22:03:23.343 INFO:tasks.ceph:Setting up mgr nodes... 2023-01-24T22:03:23.344 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-01-24T22:03:23.388 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-01-24T22:03:23.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-01-24T22:03:23.438 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-01-24T22:03:23.440 INFO:tasks.ceph:Setting up mds nodes... 2023-01-24T22:03:23.441 INFO:tasks.ceph_client:Setting up client nodes... 2023-01-24T22:03:23.442 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-24T22:03:23.478 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-01-24T22:03:23.491 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-01-24T22:03:23.528 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-01-24T22:03:23.543 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-01-24T22:03:23.544 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-24T22:03:23.544 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-01-24T22:03:23.559 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-24T22:03:23.559 INFO:tasks.ceph:role: osd.0 2023-01-24T22:03:23.560 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2023-01-24T22:03:23.560 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-24T22:03:24.085 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-24T22:03:24.085 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-24T22:03:24.085 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-24T22:03:24.086 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 2023-01-24T22:03:24.086 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-24T22:03:24.086 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2023-01-24T22:03:24.086 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-24T22:03:24.087 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-24T22:03:24.087 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-24T22:03:24.087 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-24T22:03:24.088 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2023-01-24T22:03:24.088 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-01-24T22:03:24.155 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-01-24T22:03:24.165 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: /sbin/restorecon: command not found 2023-01-24T22:03:24.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T22:03:24.167 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-01-24T22:03:24.179 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-24T22:03:24.179 INFO:tasks.ceph:role: osd.1 2023-01-24T22:03:24.179 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2023-01-24T22:03:24.180 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-24T22:03:24.722 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-24T22:03:24.723 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-24T22:03:24.723 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-24T22:03:24.724 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 2023-01-24T22:03:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-24T22:03:24.724 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2023-01-24T22:03:24.724 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-24T22:03:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-24T22:03:24.725 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-24T22:03:24.725 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-24T22:03:24.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2023-01-24T22:03:24.727 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-01-24T22:03:24.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-01-24T22:03:24.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T22:03:24.800 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: /sbin/restorecon: command not found 2023-01-24T22:03:24.800 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-01-24T22:03:24.811 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-24T22:03:24.812 INFO:tasks.ceph:role: osd.2 2023-01-24T22:03:24.812 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2023-01-24T22:03:24.812 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-24T22:03:25.273 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-24T22:03:25.274 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-24T22:03:25.274 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-24T22:03:25.274 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 2023-01-24T22:03:25.274 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-24T22:03:25.275 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2023-01-24T22:03:25.275 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-24T22:03:25.275 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-24T22:03:25.275 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-24T22:03:25.275 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-24T22:03:25.277 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2023-01-24T22:03:25.277 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-01-24T22:03:25.329 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-01-24T22:03:25.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T22:03:25.342 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: /sbin/restorecon: command not found 2023-01-24T22:03:25.343 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-01-24T22:03:25.353 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-24T22:03:25.354 INFO:tasks.ceph:role: osd.3 2023-01-24T22:03:25.354 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2023-01-24T22:03:25.354 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-24T22:03:25.885 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-24T22:03:25.886 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-24T22:03:25.886 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-24T22:03:25.886 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 2023-01-24T22:03:25.887 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-24T22:03:25.887 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2023-01-24T22:03:25.887 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-24T22:03:25.887 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-24T22:03:25.887 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-24T22:03:25.888 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-24T22:03:25.889 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2023-01-24T22:03:25.889 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-01-24T22:03:25.945 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-01-24T22:03:25.958 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: /sbin/restorecon: command not found 2023-01-24T22:03:25.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T22:03:25.959 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:26.079 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.073+0000 7f17105833c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-01-24T22:03:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.073+0000 7f17105833c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-01-24T22:03:26.118 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.113+0000 7f17105833c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:26.120 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.113+0000 7f17105833c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-24T22:03:26.404 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.397+0000 7f17105833c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.397+0000 7f17105833c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:26.405 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.397+0000 7f17105833c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:26.452 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-24T22:03:26.469 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:26.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.497+0000 7f3b0584a3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-01-24T22:03:26.506 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.501+0000 7f3b0584a3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-01-24T22:03:26.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.533+0000 7f3b0584a3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.537+0000 7f3b0584a3c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-24T22:03:26.789 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.781+0000 7f3b0584a3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.785+0000 7f3b0584a3c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:26.792 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.785+0000 7f3b0584a3c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:26.835 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-24T22:03:26.894 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.921+0000 7fed4ee9e3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-01-24T22:03:26.930 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.925+0000 7fed4ee9e3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-01-24T22:03:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.937+0000 7fed4ee9e3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:26.944 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:26.937+0000 7fed4ee9e3c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-24T22:03:27.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:27.081+0000 7fed4ee9e3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:27.085+0000 7fed4ee9e3c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:27.085+0000 7fed4ee9e3c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:27.105 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-24T22:03:27.165 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:27.197+0000 7f50276403c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-01-24T22:03:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:27.197+0000 7f50276403c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-01-24T22:03:27.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:27.209+0000 7f50276403c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:27.209+0000 7f50276403c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-24T22:03:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:27.333+0000 7f50276403c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:27.333+0000 7f50276403c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:27.342 INFO:teuthology.orchestra.run.smithi100.stderr:2023-01-24T22:03:27.333+0000 7f50276403c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:27.357 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-24T22:03:27.371 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-01-24T22:03:27.388 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-24T22:03:27.389 INFO:tasks.ceph:role: osd.4 2023-01-24T22:03:27.389 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-24T22:03:27.389 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-24T22:03:27.926 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-24T22:03:27.926 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-24T22:03:27.927 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-24T22:03:27.927 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2023-01-24T22:03:27.927 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-24T22:03:27.927 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-01-24T22:03:27.927 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-24T22:03:27.928 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-24T22:03:27.928 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-24T22:03:27.928 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-24T22:03:27.929 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-01-24T22:03:27.929 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-01-24T22:03:28.032 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-01-24T22:03:28.044 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2023-01-24T22:03:28.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T22:03:28.046 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-01-24T22:03:28.060 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-24T22:03:28.060 INFO:tasks.ceph:role: osd.5 2023-01-24T22:03:28.061 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-24T22:03:28.061 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-24T22:03:28.600 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-24T22:03:28.601 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-24T22:03:28.601 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-24T22:03:28.601 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2023-01-24T22:03:28.601 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-24T22:03:28.602 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-01-24T22:03:28.602 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-24T22:03:28.602 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-24T22:03:28.602 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-24T22:03:28.602 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-24T22:03:28.603 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-01-24T22:03:28.604 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-01-24T22:03:28.637 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-01-24T22:03:28.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T22:03:28.649 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2023-01-24T22:03:28.650 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-01-24T22:03:28.709 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-24T22:03:28.710 INFO:tasks.ceph:role: osd.6 2023-01-24T22:03:28.710 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-24T22:03:28.710 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-24T22:03:29.168 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-24T22:03:29.169 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-24T22:03:29.169 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-24T22:03:29.169 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2023-01-24T22:03:29.169 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-24T22:03:29.169 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-01-24T22:03:29.169 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-24T22:03:29.170 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-24T22:03:29.170 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-24T22:03:29.170 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-24T22:03:29.171 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-01-24T22:03:29.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-01-24T22:03:29.220 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-01-24T22:03:29.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T22:03:29.233 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2023-01-24T22:03:29.233 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-01-24T22:03:29.293 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-24T22:03:29.293 INFO:tasks.ceph:role: osd.7 2023-01-24T22:03:29.294 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-24T22:03:29.294 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-24T22:03:29.794 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-24T22:03:29.795 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-24T22:03:29.795 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-24T22:03:29.796 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 2023-01-24T22:03:29.796 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-24T22:03:29.796 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-01-24T22:03:29.797 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-24T22:03:29.797 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-24T22:03:29.797 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-24T22:03:29.797 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-24T22:03:29.799 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-01-24T22:03:29.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-01-24T22:03:29.862 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-01-24T22:03:29.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-24T22:03:29.873 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2023-01-24T22:03:29.874 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:29.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:29.937+0000 7f3d5724d3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-01-24T22:03:29.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:29.941+0000 7f3d5724d3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-01-24T22:03:29.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:29.981+0000 7f3d5724d3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:29.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:29.985+0000 7f3d5724d3c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-24T22:03:30.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.261+0000 7f3d5724d3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:30.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.261+0000 7f3d5724d3c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:30.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.261+0000 7f3d5724d3c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:30.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-24T22:03:30.326 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:30.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.357+0000 7f043409a3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-01-24T22:03:30.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.357+0000 7f043409a3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-01-24T22:03:30.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.401+0000 7f043409a3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:30.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.401+0000 7f043409a3c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-24T22:03:30.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.669+0000 7f043409a3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:30.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.669+0000 7f043409a3c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:30.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.669+0000 7f043409a3c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:30.713 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-24T22:03:30.728 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:30.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.757+0000 7f743a6273c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-01-24T22:03:30.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.757+0000 7f743a6273c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-01-24T22:03:30.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.793+0000 7f743a6273c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:30.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.793+0000 7f743a6273c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-24T22:03:30.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.953+0000 7f743a6273c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:30.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.953+0000 7f743a6273c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:30.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:30.953+0000 7f743a6273c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:30.973 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-01-24T22:03:31.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:31.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:31.065+0000 7f2eed3743c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-01-24T22:03:31.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:31.065+0000 7f2eed3743c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-01-24T22:03:31.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:31.077+0000 7f2eed3743c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:31.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:31.077+0000 7f2eed3743c0 -1 journal FileJournal::_open_file : zeroing journal 2023-01-24T22:03:31.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:31.217+0000 7f2eed3743c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:31.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:31.217+0000 7f2eed3743c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:31.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-24T22:03:31.217+0000 7f2eed3743c0 -1 journal do_read_entry(4096): bad header magic 2023-01-24T22:03:31.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-01-24T22:03:31.256 INFO:tasks.ceph:Reading keys from all nodes... 2023-01-24T22:03:31.257 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:31.257 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-01-24T22:03:31.273 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:31.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-01-24T22:03:31.284 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:31.285 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-01-24T22:03:31.340 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:31.341 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-01-24T22:03:31.351 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:31.352 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-01-24T22:03:31.363 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:31.363 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-01-24T22:03:31.379 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:31.380 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-01-24T22:03:31.436 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:31.437 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-01-24T22:03:31.446 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:31.447 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-01-24T22:03:31.457 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:31.457 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-01-24T22:03:31.473 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:31.473 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-01-24T22:03:31.481 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:31.481 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-01-24T22:03:31.523 INFO:tasks.ceph:Adding keys to all mons... 2023-01-24T22:03:31.523 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-24T22:03:31.525 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-24T22:03:31.537 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2023-01-24T22:03:31.538 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCrVdBjMiAHFxAAa/QsfQW27GfAltG6ndfPAA== 2023-01-24T22:03:31.538 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2023-01-24T22:03:31.538 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCuVdBjhgyRBBAA8dlWgSPZX2GOd9GPnF0vyw== 2023-01-24T22:03:31.539 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2023-01-24T22:03:31.539 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCuVdBj0r70HRAACQlGaDKbnQPYYFIA60Udsg== 2023-01-24T22:03:31.539 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2023-01-24T22:03:31.539 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCuVdBjsvxBNxAAopJWq900WA6H+9vJD3R/Xg== 2023-01-24T22:03:31.539 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2023-01-24T22:03:31.540 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCvVdBjJbzyCxAAif8XweZVBvx2yonEyz4Eqw== 2023-01-24T22:03:31.540 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2023-01-24T22:03:31.540 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCrVdBjWjAVGhAAWVrJPmI9Ql0MpkXzqYvlmA== 2023-01-24T22:03:31.540 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2023-01-24T22:03:31.540 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCxVdBjCRRIOBAA3uRP/jy+2PFLOGCpo64cvw== 2023-01-24T22:03:31.541 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2023-01-24T22:03:31.541 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCyVdBjFyGFFRAAl1SzReJ8D0ffV2QE8LOz/g== 2023-01-24T22:03:31.541 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2023-01-24T22:03:31.541 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCyVdBj0PKDLRAAvhq/gEj7lvSZoD95rQMN2A== 2023-01-24T22:03:31.541 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2023-01-24T22:03:31.542 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCzVdBjVaNEBBAAEy3IrQdsZFONOL3NOe1O/g== 2023-01-24T22:03:31.542 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2023-01-24T22:03:31.542 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCrVdBjXHxcHBAAK7J+zAyAGHfqTcxLLo1RYg== 2023-01-24T22:03:31.543 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2023-01-24T22:03:31.543 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCrVdBjmU2FHxAAj9DBjDB4uYqC38cj8LYv3w== 2023-01-24T22:03:31.544 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2023-01-24T22:03:31.545 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCrVdBjMiAHFxAAa/QsfQW27GfAltG6ndfPAA== 2023-01-24T22:03:31.545 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2023-01-24T22:03:31.545 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCuVdBjhgyRBBAA8dlWgSPZX2GOd9GPnF0vyw== 2023-01-24T22:03:31.545 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2023-01-24T22:03:31.545 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCuVdBj0r70HRAACQlGaDKbnQPYYFIA60Udsg== 2023-01-24T22:03:31.546 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2023-01-24T22:03:31.546 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCuVdBjsvxBNxAAopJWq900WA6H+9vJD3R/Xg== 2023-01-24T22:03:31.546 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2023-01-24T22:03:31.546 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCvVdBjJbzyCxAAif8XweZVBvx2yonEyz4Eqw== 2023-01-24T22:03:31.546 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2023-01-24T22:03:31.547 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCrVdBjWjAVGhAAWVrJPmI9Ql0MpkXzqYvlmA== 2023-01-24T22:03:31.547 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2023-01-24T22:03:31.547 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCxVdBjCRRIOBAA3uRP/jy+2PFLOGCpo64cvw== 2023-01-24T22:03:31.547 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2023-01-24T22:03:31.547 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCyVdBjFyGFFRAAl1SzReJ8D0ffV2QE8LOz/g== 2023-01-24T22:03:31.548 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2023-01-24T22:03:31.548 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCyVdBj0PKDLRAAvhq/gEj7lvSZoD95rQMN2A== 2023-01-24T22:03:31.548 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2023-01-24T22:03:31.548 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCzVdBjVaNEBBAAEy3IrQdsZFONOL3NOe1O/g== 2023-01-24T22:03:31.548 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2023-01-24T22:03:31.549 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCrVdBjXHxcHBAAK7J+zAyAGHfqTcxLLo1RYg== 2023-01-24T22:03:31.549 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2023-01-24T22:03:31.549 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCrVdBjmU2FHxAAj9DBjDB4uYqC38cj8LYv3w== 2023-01-24T22:03:31.549 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-24T22:03:31.552 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-24T22:03:31.632 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:31.643 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:31.687 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:31.690 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:31.731 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:31.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:31.816 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:31.818 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:31.862 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-24T22:03:31.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-24T22:03:31.949 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:31.952 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:31.996 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:31.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:32.043 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:32.046 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:32.126 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:32.131 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-24T22:03:32.174 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-24T22:03:32.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-24T22:03:32.265 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-24T22:03:32.267 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-24T22:03:32.318 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-01-24T22:03:32.318 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-01-24T22:03:32.334 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-24T22:03:32.386 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-01-24T22:03:32.443 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-01-24T22:03:32.455 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-24T22:03:32.510 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-01-24T22:03:32.523 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-01-24T22:03:32.539 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-24T22:03:32.639 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-01-24T22:03:32.652 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:32.655 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-24T22:03:32.660 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-01-24T22:03:32.660 INFO:tasks.ceph.mon.a:Restarting daemon 2023-01-24T22:03:32.661 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-01-24T22:03:32.664 INFO:tasks.ceph.mon.a:Started 2023-01-24T22:03:32.664 INFO:tasks.ceph.mon.c:Restarting daemon 2023-01-24T22:03:32.664 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-01-24T22:03:32.666 INFO:tasks.ceph.mon.c:Started 2023-01-24T22:03:32.667 INFO:tasks.ceph.mon.b:Restarting daemon 2023-01-24T22:03:32.667 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-01-24T22:03:32.702 INFO:tasks.ceph.mon.b:Started 2023-01-24T22:03:32.703 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-01-24T22:03:32.703 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-01-24T22:03:32.704 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-01-24T22:03:32.706 INFO:tasks.ceph.mgr.y:Started 2023-01-24T22:03:32.706 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-01-24T22:03:32.707 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-01-24T22:03:32.709 INFO:tasks.ceph.mgr.x:Started 2023-01-24T22:03:32.710 INFO:tasks.ceph:Setting crush tunables to default 2023-01-24T22:03:32.710 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd crush tunables default 2023-01-24T22:03:38.150 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2023-01-24T22:03:38.160 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-01-24T22:03:38.161 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:38.161 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-01-24T22:03:38.177 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:38.177 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-01-24T22:03:38.190 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:38.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-01-24T22:03:38.199 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-01-24T22:03:38.199 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-01-24T22:03:38.254 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:38.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-01-24T22:03:38.272 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:38.272 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-01-24T22:03:38.327 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:38.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-01-24T22:03:38.339 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-24T22:03:38.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-01-24T22:03:38.349 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new f82e6ad4-7872-466f-b01b-eb6b653addc4 0 2023-01-24T22:03:38.517 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:38.509+0000 7fb67f44f000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-24T22:03:38.607 INFO:teuthology.orchestra.run.smithi149.stdout:0 2023-01-24T22:03:38.621 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new bce6ee20-6fe8-4b58-aa20-071516ece6e4 1 2023-01-24T22:03:38.831 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-01-24T22:03:38.845 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 7a808a44-1075-4b54-80cd-c0086317e418 2 2023-01-24T22:03:39.024 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:39.016+0000 7f89019f6000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-24T22:03:39.044 INFO:teuthology.orchestra.run.smithi149.stdout:2 2023-01-24T22:03:39.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 5881f204-14ab-4d03-b4d2-c3e8ac351dae 3 2023-01-24T22:03:39.121 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:39.117+0000 7fb67f44f000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-24T22:03:39.178 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:39.173+0000 7fb67f44f000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-24T22:03:39.244 INFO:teuthology.orchestra.run.smithi149.stdout:3 2023-01-24T22:03:39.257 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new df584ea4-577e-490e-a2e8-37efc69e1a23 4 2023-01-24T22:03:39.287 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:39.281+0000 7fb67f44f000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-24T22:03:39.454 INFO:teuthology.orchestra.run.smithi149.stdout:4 2023-01-24T22:03:39.467 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new a35dba97-9b8a-4549-9b5e-95ba459d9f59 5 2023-01-24T22:03:39.502 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:39.497+0000 7fb67f44f000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-24T22:03:39.549 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:39.541+0000 7fb67f44f000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-24T22:03:39.661 INFO:teuthology.orchestra.run.smithi149.stdout:5 2023-01-24T22:03:39.670 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:39.664+0000 7f89019f6000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-24T22:03:39.676 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new f2171016-dac7-4142-b992-ca31661b8ace 6 2023-01-24T22:03:39.728 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:39.720+0000 7f89019f6000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-24T22:03:39.731 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:39.725+0000 7fb67f44f000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-24T22:03:39.788 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:39.781+0000 7fb67f44f000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-24T22:03:39.843 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:39.836+0000 7f89019f6000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-24T22:03:39.848 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:39.841+0000 7fb67f44f000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-24T22:03:39.875 INFO:teuthology.orchestra.run.smithi149.stdout:6 2023-01-24T22:03:39.890 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 540d4c28-a22b-4105-8464-884cc72aa0f1 7 2023-01-24T22:03:40.087 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:40.084+0000 7f89019f6000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-24T22:03:40.103 INFO:teuthology.orchestra.run.smithi149.stdout:7 2023-01-24T22:03:40.116 INFO:tasks.ceph.osd.0:Restarting daemon 2023-01-24T22:03:40.117 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-01-24T22:03:40.119 INFO:tasks.ceph.osd.0:Started 2023-01-24T22:03:40.119 INFO:tasks.ceph.osd.1:Restarting daemon 2023-01-24T22:03:40.120 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-01-24T22:03:40.122 INFO:tasks.ceph.osd.1:Started 2023-01-24T22:03:40.122 INFO:tasks.ceph.osd.2:Restarting daemon 2023-01-24T22:03:40.122 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-01-24T22:03:40.125 INFO:tasks.ceph.osd.2:Started 2023-01-24T22:03:40.125 INFO:tasks.ceph.osd.3:Restarting daemon 2023-01-24T22:03:40.125 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-01-24T22:03:40.128 INFO:tasks.ceph.osd.3:Started 2023-01-24T22:03:40.128 INFO:tasks.ceph.osd.4:Restarting daemon 2023-01-24T22:03:40.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-01-24T22:03:40.131 INFO:tasks.ceph.osd.4:Started 2023-01-24T22:03:40.132 INFO:tasks.ceph.osd.5:Restarting daemon 2023-01-24T22:03:40.132 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-01-24T22:03:40.135 INFO:tasks.ceph.osd.5:Started 2023-01-24T22:03:40.135 INFO:tasks.ceph.osd.6:Restarting daemon 2023-01-24T22:03:40.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-01-24T22:03:40.136 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:40.132+0000 7f89019f6000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-24T22:03:40.138 INFO:tasks.ceph.osd.6:Started 2023-01-24T22:03:40.138 INFO:tasks.ceph.osd.7:Restarting daemon 2023-01-24T22:03:40.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-01-24T22:03:40.141 INFO:tasks.ceph.osd.7:Started 2023-01-24T22:03:40.142 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-24T22:03:40.194 INFO:tasks.ceph.osd.1.smithi100.stderr:2023-01-24T22:03:40.189+0000 7fb36addc3c0 -1 Falling back to public interface 2023-01-24T22:03:40.196 INFO:tasks.ceph.osd.0.smithi100.stderr:2023-01-24T22:03:40.189+0000 7f9b5af043c0 -1 Falling back to public interface 2023-01-24T22:03:40.197 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-01-24T22:03:40.192+0000 7f691015d3c0 -1 Falling back to public interface 2023-01-24T22:03:40.197 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-24T22:03:40.196+0000 7f578ede03c0 -1 Falling back to public interface 2023-01-24T22:03:40.201 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-01-24T22:03:40.193+0000 7ff670b683c0 -1 Falling back to public interface 2023-01-24T22:03:40.210 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-24T22:03:40.208+0000 7f900d9663c0 -1 Falling back to public interface 2023-01-24T22:03:40.212 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-24T22:03:40.208+0000 7f578ede03c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:40.212 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-24T22:03:40.208+0000 7f578ede03c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.212 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-24T22:03:40.208+0000 7f578ede03c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.213 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-01-24T22:03:40.208+0000 7f691015d3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:40.213 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-01-24T22:03:40.208+0000 7f691015d3c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.213 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-01-24T22:03:40.208+0000 7f691015d3c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.215 INFO:tasks.ceph.osd.0.smithi100.stderr:2023-01-24T22:03:40.209+0000 7f9b5af043c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:40.215 INFO:tasks.ceph.osd.0.smithi100.stderr:2023-01-24T22:03:40.209+0000 7f9b5af043c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.215 INFO:tasks.ceph.osd.0.smithi100.stderr:2023-01-24T22:03:40.209+0000 7f9b5af043c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.216 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-24T22:03:40.212+0000 7f5503a143c0 -1 Falling back to public interface 2023-01-24T22:03:40.216 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-01-24T22:03:40.209+0000 7f1e88afa3c0 -1 Falling back to public interface 2023-01-24T22:03:40.217 INFO:tasks.ceph.osd.1.smithi100.stderr:2023-01-24T22:03:40.213+0000 7fb36addc3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:40.218 INFO:tasks.ceph.osd.1.smithi100.stderr:2023-01-24T22:03:40.213+0000 7fb36addc3c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.218 INFO:tasks.ceph.osd.1.smithi100.stderr:2023-01-24T22:03:40.213+0000 7fb36addc3c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.219 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-24T22:03:40.216+0000 7f578ede03c0 -1 osd.5 0 log_to_monitors true 2023-01-24T22:03:40.219 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-01-24T22:03:40.216+0000 7f691015d3c0 -1 osd.4 0 log_to_monitors true 2023-01-24T22:03:40.221 INFO:tasks.ceph.osd.0.smithi100.stderr:2023-01-24T22:03:40.213+0000 7f9b5af043c0 -1 osd.0 0 log_to_monitors true 2023-01-24T22:03:40.224 INFO:tasks.ceph.osd.1.smithi100.stderr:2023-01-24T22:03:40.217+0000 7fb36addc3c0 -1 osd.1 0 log_to_monitors true 2023-01-24T22:03:40.230 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-01-24T22:03:40.225+0000 7ff670b683c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:40.230 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-01-24T22:03:40.225+0000 7ff670b683c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.230 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-01-24T22:03:40.225+0000 7ff670b683c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.232 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-24T22:03:40.228+0000 7f900d9663c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:40.232 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-24T22:03:40.228+0000 7f900d9663c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.233 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-24T22:03:40.228+0000 7f900d9663c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.235 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-01-24T22:03:40.229+0000 7ff670b683c0 -1 osd.2 0 log_to_monitors true 2023-01-24T22:03:40.237 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-24T22:03:40.236+0000 7f5503a143c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:40.237 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-24T22:03:40.236+0000 7f5503a143c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.237 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-24T22:03:40.236+0000 7f5503a143c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.238 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-24T22:03:40.236+0000 7f900d9663c0 -1 osd.7 0 log_to_monitors true 2023-01-24T22:03:40.240 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-01-24T22:03:40.233+0000 7f1e88afa3c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-01-24T22:03:40.240 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-01-24T22:03:40.233+0000 7f1e88afa3c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.241 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-01-24T22:03:40.233+0000 7f1e88afa3c0 -1 journal do_read_entry(8192): bad header magic 2023-01-24T22:03:40.243 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-24T22:03:40.240+0000 7f5503a143c0 -1 osd.6 0 log_to_monitors true 2023-01-24T22:03:40.245 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-01-24T22:03:40.241+0000 7f1e88afa3c0 -1 osd.3 0 log_to_monitors true 2023-01-24T22:03:40.270 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:40.265+0000 7fb67f44f000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-24T22:03:40.337 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:40.337 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":10,"fsid":"2db70b95-3a95-440a-afc1-b7f5c81bdc31","created":"2023-01-24T22:03:38.026102+0000","modified":"2023-01-24T22:03:40.094695+0000","last_up_change":"0.000000","last_in_change":"2023-01-24T22:03:40.094695+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"f82e6ad4-7872-466f-b01b-eb6b653addc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bce6ee20-6fe8-4b58-aa20-071516ece6e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a808a44-1075-4b54-80cd-c0086317e418","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5881f204-14ab-4d03-b4d2-c3e8ac351dae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"df584ea4-577e-490e-a2e8-37efc69e1a23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a35dba97-9b8a-4549-9b5e-95ba459d9f59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f2171016-dac7-4142-b992-ca31661b8ace","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"540d4c28-a22b-4105-8464-884cc72aa0f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-24T22:03:40.348 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-01-24T22:03:40.349 INFO:tasks.ceph:Waiting for OSDs to come up 2023-01-24T22:03:40.357 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:40.356+0000 7f89019f6000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-24T22:03:40.380 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:40.373+0000 7fb67f44f000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-24T22:03:40.419 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:40.416+0000 7f89019f6000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-24T22:03:40.486 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:40.484+0000 7f89019f6000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-24T22:03:40.582 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:40.577+0000 7fb67f44f000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-24T22:03:40.825 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:40.817+0000 7fb67f44f000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-24T22:03:40.890 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:40.885+0000 7fb67f44f000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-24T22:03:40.923 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:40.920+0000 7f89019f6000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-24T22:03:40.940 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:40.933+0000 7fb67f44f000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-24T22:03:40.996 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:40.989+0000 7fb67f44f000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-24T22:03:41.044 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:41.040+0000 7f89019f6000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-24T22:03:41.156 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-24T22:03:41.177 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:41.169+0000 7fb67f44f000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-24T22:03:41.271 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:41.268+0000 7f89019f6000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-24T22:03:41.329 INFO:teuthology.misc.health.smithi100.stdout: 2023-01-24T22:03:41.329 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":11,"fsid":"2db70b95-3a95-440a-afc1-b7f5c81bdc31","created":"2023-01-24T22:03:38.026102+0000","modified":"2023-01-24T22:03:41.096879+0000","last_up_change":"0.000000","last_in_change":"2023-01-24T22:03:40.094695+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"f82e6ad4-7872-466f-b01b-eb6b653addc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bce6ee20-6fe8-4b58-aa20-071516ece6e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7a808a44-1075-4b54-80cd-c0086317e418","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5881f204-14ab-4d03-b4d2-c3e8ac351dae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"df584ea4-577e-490e-a2e8-37efc69e1a23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a35dba97-9b8a-4549-9b5e-95ba459d9f59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f2171016-dac7-4142-b992-ca31661b8ace","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"540d4c28-a22b-4105-8464-884cc72aa0f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-24T22:03:41.339 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-01-24T22:03:41.344 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:41.337+0000 7fb67f44f000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-24T22:03:41.408 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:41.401+0000 7fb67f44f000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-24T22:03:41.529 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:41.524+0000 7f89019f6000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-24T22:03:41.564 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:41.557+0000 7fb67f44f000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-24T22:03:41.594 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:41.592+0000 7f89019f6000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-24T22:03:41.630 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:41.625+0000 7fb67f44f000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-24T22:03:41.645 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:41.644+0000 7f89019f6000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-24T22:03:41.701 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:41.700+0000 7f89019f6000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-24T22:03:41.891 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:41.888+0000 7f89019f6000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-24T22:03:42.074 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:42.072+0000 7f89019f6000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-24T22:03:42.110 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-24T22:03:42.108+0000 7f900a12a700 -1 osd.7 0 waiting for initial osdmap 2023-01-24T22:03:42.111 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-24T22:03:42.108+0000 7f578b5a4700 -1 osd.5 0 waiting for initial osdmap 2023-01-24T22:03:42.111 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-01-24T22:03:42.108+0000 7f690c120700 -1 osd.4 0 waiting for initial osdmap 2023-01-24T22:03:42.112 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-01-24T22:03:42.108+0000 7f68fb6b0700 -1 osd.4 0 handle_osd_map injecting map crc failure 2023-01-24T22:03:42.112 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-24T22:03:42.108+0000 7f8ff8eb9700 -1 osd.7 0 handle_osd_map injecting map crc failure 2023-01-24T22:03:42.113 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-24T22:03:42.108+0000 7f577a333700 -1 osd.5 0 handle_osd_map injecting map crc failure 2023-01-24T22:03:42.113 INFO:tasks.ceph.osd.0.smithi100.stderr:2023-01-24T22:03:42.105+0000 7f9b576c8700 -1 osd.0 0 waiting for initial osdmap 2023-01-24T22:03:42.114 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-01-24T22:03:42.105+0000 7ff66cb2b700 -1 osd.2 0 waiting for initial osdmap 2023-01-24T22:03:42.114 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-01-24T22:03:42.105+0000 7f1e852be700 -1 osd.3 0 waiting for initial osdmap 2023-01-24T22:03:42.115 INFO:tasks.ceph.osd.0.smithi100.stderr:2023-01-24T22:03:42.105+0000 7f9b46457700 -1 osd.0 0 handle_osd_map injecting map crc failure 2023-01-24T22:03:42.115 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-01-24T22:03:42.105+0000 7ff65c0bb700 -1 osd.2 0 handle_osd_map injecting map crc failure 2023-01-24T22:03:42.115 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-01-24T22:03:42.105+0000 7f1e7404d700 -1 osd.3 0 handle_osd_map injecting map crc failure 2023-01-24T22:03:42.116 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-24T22:03:42.112+0000 7f54ff9d7700 -1 osd.6 0 waiting for initial osdmap 2023-01-24T22:03:42.117 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-24T22:03:42.112+0000 7f54eef67700 -1 osd.6 0 handle_osd_map injecting map crc failure 2023-01-24T22:03:42.118 INFO:tasks.ceph.osd.1.smithi100.stderr:2023-01-24T22:03:42.113+0000 7fb366d9f700 -1 osd.1 0 waiting for initial osdmap 2023-01-24T22:03:42.119 INFO:tasks.ceph.osd.1.smithi100.stderr:2023-01-24T22:03:42.113+0000 7fb35632f700 -1 osd.1 0 handle_osd_map injecting map crc failure 2023-01-24T22:03:42.137 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-01-24T22:03:42.136+0000 7f69086ca700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-24T22:03:42.138 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-24T22:03:42.136+0000 7f578734d700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-24T22:03:42.139 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-24T22:03:42.136+0000 7f54fbf81700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-24T22:03:42.139 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-24T22:03:42.136+0000 7f9005ed3700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-24T22:03:42.141 INFO:tasks.ceph.osd.0.smithi100.stderr:2023-01-24T22:03:42.137+0000 7f9b53471700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-24T22:03:42.145 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:42.144+0000 7f89019f6000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-24T22:03:42.146 INFO:tasks.ceph.osd.1.smithi100.stderr:2023-01-24T22:03:42.141+0000 7fb363349700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-24T22:03:42.162 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-01-24T22:03:42.157+0000 7ff6690d5700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-24T22:03:42.162 INFO:tasks.ceph.osd.3.smithi100.stderr:2023-01-24T22:03:42.157+0000 7f1e81067700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-24T22:03:42.314 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:42.312+0000 7f89019f6000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-24T22:03:42.325 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:42.321+0000 7fb67f44f000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-24T22:03:42.389 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:42.384+0000 7f89019f6000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-24T22:03:43.113 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-24T22:03:43.108+0000 7f89019f6000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-24T22:03:43.359 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:43.353+0000 7fb66858d700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-01-24T22:03:43.359 INFO:tasks.ceph.mgr.y.smithi100.stderr:2023-01-24T22:03:43.353+0000 7fb66858d700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-01-24T22:03:46.163 INFO:tasks.ceph.osd.2.smithi100.stderr:2023-01-24T22:03:46.157+0000 7ff65c0bb700 -1 osd.2 14 handle_osd_map injecting map crc failure 2023-01-24T22:03:47.227 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-24T22:03:47.224+0000 7f577832f700 -1 osd.5 13 handle_osd_map injecting map crc failure 2023-01-24T22:03:47.246 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-24T22:03:47.244+0000 7f54ecf63700 -1 osd.6 13 handle_osd_map injecting map crc failure 2023-01-24T22:03:48.147 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-24T22:03:48.436 INFO:teuthology.misc.health.smithi100.stdout: 2023-01-24T22:03:48.437 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":17,"fsid":"2db70b95-3a95-440a-afc1-b7f5c81bdc31","created":"2023-01-24T22:03:38.026102+0000","modified":"2023-01-24T22:03:47.160061+0000","last_up_change":"2023-01-24T22:03:43.110044+0000","last_in_change":"2023-01-24T22:03:40.094695+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-24T22:03:44.399267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"f82e6ad4-7872-466f-b01b-eb6b653addc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":23669},{"type":"v1","addr":"172.21.15.100:6808","nonce":23669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":23669},{"type":"v1","addr":"172.21.15.100:6811","nonce":23669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":23669},{"type":"v1","addr":"172.21.15.100:6815","nonce":23669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":23669},{"type":"v1","addr":"172.21.15.100:6813","nonce":23669}]},"public_addr":"172.21.15.100:6808/23669","cluster_addr":"172.21.15.100:6811/23669","heartbeat_back_addr":"172.21.15.100:6815/23669","heartbeat_front_addr":"172.21.15.100:6813/23669","state":["exists","up"]},{"osd":1,"uuid":"bce6ee20-6fe8-4b58-aa20-071516ece6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":23668},{"type":"v1","addr":"172.21.15.100:6801","nonce":23668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":23668},{"type":"v1","addr":"172.21.15.100:6803","nonce":23668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":23668},{"type":"v1","addr":"172.21.15.100:6809","nonce":23668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":23668},{"type":"v1","addr":"172.21.15.100:6805","nonce":23668}]},"public_addr":"172.21.15.100:6801/23668","cluster_addr":"172.21.15.100:6803/23668","heartbeat_back_addr":"172.21.15.100:6809/23668","heartbeat_front_addr":"172.21.15.100:6805/23668","state":["exists","up"]},{"osd":2,"uuid":"7a808a44-1075-4b54-80cd-c0086317e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":23670},{"type":"v1","addr":"172.21.15.100:6817","nonce":23670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":23670},{"type":"v1","addr":"172.21.15.100:6819","nonce":23670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":23670},{"type":"v1","addr":"172.21.15.100:6823","nonce":23670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":23670},{"type":"v1","addr":"172.21.15.100:6821","nonce":23670}]},"public_addr":"172.21.15.100:6817/23670","cluster_addr":"172.21.15.100:6819/23670","heartbeat_back_addr":"172.21.15.100:6823/23670","heartbeat_front_addr":"172.21.15.100:6821/23670","state":["exists","up"]},{"osd":3,"uuid":"5881f204-14ab-4d03-b4d2-c3e8ac351dae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":23671},{"type":"v1","addr":"172.21.15.100:6825","nonce":23671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":23671},{"type":"v1","addr":"172.21.15.100:6827","nonce":23671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":23671},{"type":"v1","addr":"172.21.15.100:6831","nonce":23671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":23671},{"type":"v1","addr":"172.21.15.100:6829","nonce":23671}]},"public_addr":"172.21.15.100:6825/23671","cluster_addr":"172.21.15.100:6827/23671","heartbeat_back_addr":"172.21.15.100:6831/23671","heartbeat_front_addr":"172.21.15.100:6829/23671","state":["exists","up"]},{"osd":4,"uuid":"df584ea4-577e-490e-a2e8-37efc69e1a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":23728},{"type":"v1","addr":"172.21.15.149:6801","nonce":23728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":23728},{"type":"v1","addr":"172.21.15.149:6803","nonce":23728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":23728},{"type":"v1","addr":"172.21.15.149:6809","nonce":23728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":23728},{"type":"v1","addr":"172.21.15.149:6806","nonce":23728}]},"public_addr":"172.21.15.149:6801/23728","cluster_addr":"172.21.15.149:6803/23728","heartbeat_back_addr":"172.21.15.149:6809/23728","heartbeat_front_addr":"172.21.15.149:6806/23728","state":["exists","up"]},{"osd":5,"uuid":"a35dba97-9b8a-4549-9b5e-95ba459d9f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":23729},{"type":"v1","addr":"172.21.15.149:6807","nonce":23729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":23729},{"type":"v1","addr":"172.21.15.149:6811","nonce":23729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":23729},{"type":"v1","addr":"172.21.15.149:6815","nonce":23729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":23729},{"type":"v1","addr":"172.21.15.149:6813","nonce":23729}]},"public_addr":"172.21.15.149:6807/23729","cluster_addr":"172.21.15.149:6811/23729","heartbeat_back_addr":"172.21.15.149:6815/23729","heartbeat_front_addr":"172.21.15.149:6813/23729","state":["exists","up"]},{"osd":6,"uuid":"f2171016-dac7-4142-b992-ca31661b8ace","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":23741},{"type":"v1","addr":"172.21.15.149:6824","nonce":23741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":23741},{"type":"v1","addr":"172.21.15.149:6827","nonce":23741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":23741},{"type":"v1","addr":"172.21.15.149:6831","nonce":23741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":23741},{"type":"v1","addr":"172.21.15.149:6829","nonce":23741}]},"public_addr":"172.21.15.149:6824/23741","cluster_addr":"172.21.15.149:6827/23741","heartbeat_back_addr":"172.21.15.149:6831/23741","heartbeat_front_addr":"172.21.15.149:6829/23741","state":["exists","up"]},{"osd":7,"uuid":"540d4c28-a22b-4105-8464-884cc72aa0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":23730},{"type":"v1","addr":"172.21.15.149:6817","nonce":23730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":23730},{"type":"v1","addr":"172.21.15.149:6819","nonce":23730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":23730},{"type":"v1","addr":"172.21.15.149:6825","nonce":23730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":23730},{"type":"v1","addr":"172.21.15.149:6821","nonce":23730}]},"public_addr":"172.21.15.149:6817/23730","cluster_addr":"172.21.15.149:6819/23730","heartbeat_back_addr":"172.21.15.149:6825/23730","heartbeat_front_addr":"172.21.15.149:6821/23730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.193684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.264029+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.189372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.231269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.228030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.241445+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.221248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.274719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-24T22:03:48.450 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-01-24T22:03:48.451 INFO:tasks.ceph:Creating RBD pool 2023-01-24T22:03:48.451 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd pool create rbd 8 2023-01-24T22:03:49.199 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'rbd' created 2023-01-24T22:03:49.209 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-01-24T22:03:50.035 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-24T22:03:50.032+0000 7f577a333700 -1 osd.5 17 handle_osd_map injecting map crc failure 2023-01-24T22:03:50.206 INFO:teuthology.orchestra.run.smithi100.stderr:enabled application 'rbd' on pool 'rbd' 2023-01-24T22:03:50.218 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-01-24T22:03:50.219 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-24T22:03:50.219 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-01-24T22:03:50.220 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-01-24T22:03:50.221 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-01-24T22:03:50.548 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:50.563 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":4,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":23566},{"type":"v1","addr":"172.21.15.100:6833","nonce":23566}]},"active_addr":"172.21.15.100:6833/23566","active_change":"2023-01-24T22:03:42.326259+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4126,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2296381994}]},{"addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3479631875}]},{"addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":889938329}]}]}} 2023-01-24T22:03:50.569 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-01-24T22:03:50.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-01-24T22:03:50.570 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-24T22:03:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:50.864 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"fsid":"2db70b95-3a95-440a-afc1-b7f5c81bdc31","created":"2023-01-24T22:03:38.026102+0000","modified":"2023-01-24T22:03:50.183869+0000","last_up_change":"2023-01-24T22:03:43.110044+0000","last_in_change":"2023-01-24T22:03:40.094695+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-24T22:03:44.399267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-01-24T22:03:48.778706+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f82e6ad4-7872-466f-b01b-eb6b653addc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":23669},{"type":"v1","addr":"172.21.15.100:6808","nonce":23669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":23669},{"type":"v1","addr":"172.21.15.100:6811","nonce":23669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":23669},{"type":"v1","addr":"172.21.15.100:6815","nonce":23669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":23669},{"type":"v1","addr":"172.21.15.100:6813","nonce":23669}]},"public_addr":"172.21.15.100:6808/23669","cluster_addr":"172.21.15.100:6811/23669","heartbeat_back_addr":"172.21.15.100:6815/23669","heartbeat_front_addr":"172.21.15.100:6813/23669","state":["exists","up"]},{"osd":1,"uuid":"bce6ee20-6fe8-4b58-aa20-071516ece6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":23668},{"type":"v1","addr":"172.21.15.100:6801","nonce":23668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":23668},{"type":"v1","addr":"172.21.15.100:6803","nonce":23668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":23668},{"type":"v1","addr":"172.21.15.100:6809","nonce":23668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":23668},{"type":"v1","addr":"172.21.15.100:6805","nonce":23668}]},"public_addr":"172.21.15.100:6801/23668","cluster_addr":"172.21.15.100:6803/23668","heartbeat_back_addr":"172.21.15.100:6809/23668","heartbeat_front_addr":"172.21.15.100:6805/23668","state":["exists","up"]},{"osd":2,"uuid":"7a808a44-1075-4b54-80cd-c0086317e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":23670},{"type":"v1","addr":"172.21.15.100:6817","nonce":23670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":23670},{"type":"v1","addr":"172.21.15.100:6819","nonce":23670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":23670},{"type":"v1","addr":"172.21.15.100:6823","nonce":23670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":23670},{"type":"v1","addr":"172.21.15.100:6821","nonce":23670}]},"public_addr":"172.21.15.100:6817/23670","cluster_addr":"172.21.15.100:6819/23670","heartbeat_back_addr":"172.21.15.100:6823/23670","heartbeat_front_addr":"172.21.15.100:6821/23670","state":["exists","up"]},{"osd":3,"uuid":"5881f204-14ab-4d03-b4d2-c3e8ac351dae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":23671},{"type":"v1","addr":"172.21.15.100:6825","nonce":23671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":23671},{"type":"v1","addr":"172.21.15.100:6827","nonce":23671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":23671},{"type":"v1","addr":"172.21.15.100:6831","nonce":23671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":23671},{"type":"v1","addr":"172.21.15.100:6829","nonce":23671}]},"public_addr":"172.21.15.100:6825/23671","cluster_addr":"172.21.15.100:6827/23671","heartbeat_back_addr":"172.21.15.100:6831/23671","heartbeat_front_addr":"172.21.15.100:6829/23671","state":["exists","up"]},{"osd":4,"uuid":"df584ea4-577e-490e-a2e8-37efc69e1a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":23728},{"type":"v1","addr":"172.21.15.149:6801","nonce":23728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":23728},{"type":"v1","addr":"172.21.15.149:6803","nonce":23728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":23728},{"type":"v1","addr":"172.21.15.149:6809","nonce":23728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":23728},{"type":"v1","addr":"172.21.15.149:6806","nonce":23728}]},"public_addr":"172.21.15.149:6801/23728","cluster_addr":"172.21.15.149:6803/23728","heartbeat_back_addr":"172.21.15.149:6809/23728","heartbeat_front_addr":"172.21.15.149:6806/23728","state":["exists","up"]},{"osd":5,"uuid":"a35dba97-9b8a-4549-9b5e-95ba459d9f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":23729},{"type":"v1","addr":"172.21.15.149:6807","nonce":23729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":23729},{"type":"v1","addr":"172.21.15.149:6811","nonce":23729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":23729},{"type":"v1","addr":"172.21.15.149:6815","nonce":23729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":23729},{"type":"v1","addr":"172.21.15.149:6813","nonce":23729}]},"public_addr":"172.21.15.149:6807/23729","cluster_addr":"172.21.15.149:6811/23729","heartbeat_back_addr":"172.21.15.149:6815/23729","heartbeat_front_addr":"172.21.15.149:6813/23729","state":["exists","up"]},{"osd":6,"uuid":"f2171016-dac7-4142-b992-ca31661b8ace","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":23741},{"type":"v1","addr":"172.21.15.149:6824","nonce":23741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":23741},{"type":"v1","addr":"172.21.15.149:6827","nonce":23741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":23741},{"type":"v1","addr":"172.21.15.149:6831","nonce":23741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":23741},{"type":"v1","addr":"172.21.15.149:6829","nonce":23741}]},"public_addr":"172.21.15.149:6824/23741","cluster_addr":"172.21.15.149:6827/23741","heartbeat_back_addr":"172.21.15.149:6831/23741","heartbeat_front_addr":"172.21.15.149:6829/23741","state":["exists","up"]},{"osd":7,"uuid":"540d4c28-a22b-4105-8464-884cc72aa0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":23730},{"type":"v1","addr":"172.21.15.149:6817","nonce":23730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":23730},{"type":"v1","addr":"172.21.15.149:6819","nonce":23730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":23730},{"type":"v1","addr":"172.21.15.149:6825","nonce":23730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":23730},{"type":"v1","addr":"172.21.15.149:6821","nonce":23730}]},"public_addr":"172.21.15.149:6817/23730","cluster_addr":"172.21.15.149:6819/23730","heartbeat_back_addr":"172.21.15.149:6825/23730","heartbeat_front_addr":"172.21.15.149:6821/23730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.193684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.264029+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.189372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.231269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.228030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.241445+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.221248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.274719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-24T22:03:50.884 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-01-24T22:03:50.884 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-24T22:03:51.169 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:51.169 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"fsid":"2db70b95-3a95-440a-afc1-b7f5c81bdc31","created":"2023-01-24T22:03:38.026102+0000","modified":"2023-01-24T22:03:50.183869+0000","last_up_change":"2023-01-24T22:03:43.110044+0000","last_in_change":"2023-01-24T22:03:40.094695+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-24T22:03:44.399267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-01-24T22:03:48.778706+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f82e6ad4-7872-466f-b01b-eb6b653addc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":23669},{"type":"v1","addr":"172.21.15.100:6808","nonce":23669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":23669},{"type":"v1","addr":"172.21.15.100:6811","nonce":23669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":23669},{"type":"v1","addr":"172.21.15.100:6815","nonce":23669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":23669},{"type":"v1","addr":"172.21.15.100:6813","nonce":23669}]},"public_addr":"172.21.15.100:6808/23669","cluster_addr":"172.21.15.100:6811/23669","heartbeat_back_addr":"172.21.15.100:6815/23669","heartbeat_front_addr":"172.21.15.100:6813/23669","state":["exists","up"]},{"osd":1,"uuid":"bce6ee20-6fe8-4b58-aa20-071516ece6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":23668},{"type":"v1","addr":"172.21.15.100:6801","nonce":23668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":23668},{"type":"v1","addr":"172.21.15.100:6803","nonce":23668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":23668},{"type":"v1","addr":"172.21.15.100:6809","nonce":23668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":23668},{"type":"v1","addr":"172.21.15.100:6805","nonce":23668}]},"public_addr":"172.21.15.100:6801/23668","cluster_addr":"172.21.15.100:6803/23668","heartbeat_back_addr":"172.21.15.100:6809/23668","heartbeat_front_addr":"172.21.15.100:6805/23668","state":["exists","up"]},{"osd":2,"uuid":"7a808a44-1075-4b54-80cd-c0086317e418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":23670},{"type":"v1","addr":"172.21.15.100:6817","nonce":23670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":23670},{"type":"v1","addr":"172.21.15.100:6819","nonce":23670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":23670},{"type":"v1","addr":"172.21.15.100:6823","nonce":23670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":23670},{"type":"v1","addr":"172.21.15.100:6821","nonce":23670}]},"public_addr":"172.21.15.100:6817/23670","cluster_addr":"172.21.15.100:6819/23670","heartbeat_back_addr":"172.21.15.100:6823/23670","heartbeat_front_addr":"172.21.15.100:6821/23670","state":["exists","up"]},{"osd":3,"uuid":"5881f204-14ab-4d03-b4d2-c3e8ac351dae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":23671},{"type":"v1","addr":"172.21.15.100:6825","nonce":23671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":23671},{"type":"v1","addr":"172.21.15.100:6827","nonce":23671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":23671},{"type":"v1","addr":"172.21.15.100:6831","nonce":23671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":23671},{"type":"v1","addr":"172.21.15.100:6829","nonce":23671}]},"public_addr":"172.21.15.100:6825/23671","cluster_addr":"172.21.15.100:6827/23671","heartbeat_back_addr":"172.21.15.100:6831/23671","heartbeat_front_addr":"172.21.15.100:6829/23671","state":["exists","up"]},{"osd":4,"uuid":"df584ea4-577e-490e-a2e8-37efc69e1a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":23728},{"type":"v1","addr":"172.21.15.149:6801","nonce":23728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":23728},{"type":"v1","addr":"172.21.15.149:6803","nonce":23728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":23728},{"type":"v1","addr":"172.21.15.149:6809","nonce":23728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":23728},{"type":"v1","addr":"172.21.15.149:6806","nonce":23728}]},"public_addr":"172.21.15.149:6801/23728","cluster_addr":"172.21.15.149:6803/23728","heartbeat_back_addr":"172.21.15.149:6809/23728","heartbeat_front_addr":"172.21.15.149:6806/23728","state":["exists","up"]},{"osd":5,"uuid":"a35dba97-9b8a-4549-9b5e-95ba459d9f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6805","nonce":23729},{"type":"v1","addr":"172.21.15.149:6807","nonce":23729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":23729},{"type":"v1","addr":"172.21.15.149:6811","nonce":23729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":23729},{"type":"v1","addr":"172.21.15.149:6815","nonce":23729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":23729},{"type":"v1","addr":"172.21.15.149:6813","nonce":23729}]},"public_addr":"172.21.15.149:6807/23729","cluster_addr":"172.21.15.149:6811/23729","heartbeat_back_addr":"172.21.15.149:6815/23729","heartbeat_front_addr":"172.21.15.149:6813/23729","state":["exists","up"]},{"osd":6,"uuid":"f2171016-dac7-4142-b992-ca31661b8ace","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":23741},{"type":"v1","addr":"172.21.15.149:6824","nonce":23741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":23741},{"type":"v1","addr":"172.21.15.149:6827","nonce":23741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":23741},{"type":"v1","addr":"172.21.15.149:6831","nonce":23741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":23741},{"type":"v1","addr":"172.21.15.149:6829","nonce":23741}]},"public_addr":"172.21.15.149:6824/23741","cluster_addr":"172.21.15.149:6827/23741","heartbeat_back_addr":"172.21.15.149:6831/23741","heartbeat_front_addr":"172.21.15.149:6829/23741","state":["exists","up"]},{"osd":7,"uuid":"540d4c28-a22b-4105-8464-884cc72aa0f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":23730},{"type":"v1","addr":"172.21.15.149:6817","nonce":23730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":23730},{"type":"v1","addr":"172.21.15.149:6819","nonce":23730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":23730},{"type":"v1","addr":"172.21.15.149:6825","nonce":23730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":23730},{"type":"v1","addr":"172.21.15.149:6821","nonce":23730}]},"public_addr":"172.21.15.149:6817/23730","cluster_addr":"172.21.15.149:6819/23730","heartbeat_back_addr":"172.21.15.149:6825/23730","heartbeat_front_addr":"172.21.15.149:6821/23730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.193684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.264029+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.189372+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.231269+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.228030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.241445+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.221248+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-01-24T22:03:41.274719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-24T22:03:51.182 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-01-24T22:03:51.183 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-01-24T22:03:51.183 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-01-24T22:03:51.184 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-01-24T22:03:51.185 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-01-24T22:03:51.185 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-01-24T22:03:51.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-01-24T22:03:51.187 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-01-24T22:03:51.388 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:51.389 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-24T22:03:51.390 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:51.391 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-24T22:03:51.393 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:51.393 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-24T22:03:51.401 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:51.402 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-24T22:03:51.403 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:51.404 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-24T22:03:51.406 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:51.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-24T22:03:51.407 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:51.408 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-24T22:03:51.414 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:51.415 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-24T22:03:51.822 INFO:teuthology.orchestra.run.smithi100.stdout:55834574850 2023-01-24T22:03:51.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.0 2023-01-24T22:03:51.848 INFO:teuthology.orchestra.run.smithi100.stdout:55834574850 2023-01-24T22:03:51.860 INFO:teuthology.orchestra.run.smithi100.stdout:55834574850 2023-01-24T22:03:51.861 INFO:teuthology.orchestra.run.smithi100.stdout:55834574850 2023-01-24T22:03:51.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.3 2023-01-24T22:03:51.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.2 2023-01-24T22:03:51.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.1 2023-01-24T22:03:51.879 INFO:teuthology.orchestra.run.smithi100.stdout:55834574850 2023-01-24T22:03:51.887 INFO:teuthology.orchestra.run.smithi100.stdout:55834574850 2023-01-24T22:03:51.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.5 2023-01-24T22:03:51.898 INFO:teuthology.orchestra.run.smithi100.stdout:55834574850 2023-01-24T22:03:51.903 INFO:teuthology.orchestra.run.smithi100.stdout:55834574850 2023-01-24T22:03:51.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.7 2023-01-24T22:03:51.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.4 2023-01-24T22:03:51.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.6 2023-01-24T22:03:52.528 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-24T22:03:52.524+0000 7f8ff6eb5700 -1 osd.7 20 handle_osd_map injecting map crc failure 2023-01-24T22:03:52.841 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-24T22:03:52.865 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-24T22:03:52.873 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-24T22:03:52.873 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-24T22:03:52.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-24T22:03:52.906 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-24T22:03:52.915 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-24T22:03:52.916 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-24T22:03:53.289 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:53.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.0 2023-01-24T22:03:53.304 DEBUG:teuthology.parallel:result is None 2023-01-24T22:03:53.328 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:53.329 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:53.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.3 2023-01-24T22:03:53.345 DEBUG:teuthology.parallel:result is None 2023-01-24T22:03:53.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.5 2023-01-24T22:03:53.348 DEBUG:teuthology.parallel:result is None 2023-01-24T22:03:53.353 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:53.356 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:53.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.1 2023-01-24T22:03:53.370 DEBUG:teuthology.parallel:result is None 2023-01-24T22:03:53.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.2 2023-01-24T22:03:53.373 DEBUG:teuthology.parallel:result is None 2023-01-24T22:03:53.376 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:53.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.7 2023-01-24T22:03:53.388 DEBUG:teuthology.parallel:result is None 2023-01-24T22:03:53.391 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:53.396 INFO:teuthology.orchestra.run.smithi100.stdout:55834574851 2023-01-24T22:03:53.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.4 2023-01-24T22:03:53.403 DEBUG:teuthology.parallel:result is None 2023-01-24T22:03:53.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.6 2023-01-24T22:03:53.407 DEBUG:teuthology.parallel:result is None 2023-01-24T22:03:53.408 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-24T22:03:53.409 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-24T22:03:53.718 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:53.720 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-01-24T22:03:53.729 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-01-24T22:03:52.340736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":83,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6368140,"kb_used_data":743227596,"kb_used_omap":412,"kb_used_meta":0,"kb_avail":743226900,"statfs":{"total":767585320960,"available":761064345600,"internally_reserved":712704,"allocated":761065058304,"data_stored":761065058304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":422103,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":10,"commit_latency_ns":0,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262156,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":44,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.155182"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.209123+0000","last_change":"2023-01-24T22:03:50.209123+0000","last_active":"2023-01-24T22:03:50.209123+0000","last_peered":"2023-01-24T22:03:50.209123+0000","last_clean":"2023-01-24T22:03:50.209123+0000","last_became_active":"2023-01-24T22:03:50.208212+0000","last_became_peered":"2023-01-24T22:03:50.208212+0000","last_unstale":"2023-01-24T22:03:50.209123+0000","last_undegraded":"2023-01-24T22:03:50.209123+0000","last_fullsized":"2023-01-24T22:03:50.209123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:13.078024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.205813+0000","last_change":"2023-01-24T22:03:50.205463+0000","last_active":"2023-01-24T22:03:50.205813+0000","last_peered":"2023-01-24T22:03:50.205813+0000","last_clean":"2023-01-24T22:03:50.205813+0000","last_became_active":"2023-01-24T22:03:50.205045+0000","last_became_peered":"2023-01-24T22:03:50.205045+0000","last_unstale":"2023-01-24T22:03:50.205813+0000","last_undegraded":"2023-01-24T22:03:50.205813+0000","last_fullsized":"2023-01-24T22:03:50.205813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:10.456514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.299943+0000","last_change":"2023-01-24T22:03:50.299943+0000","last_active":"2023-01-24T22:03:50.299943+0000","last_peered":"2023-01-24T22:03:50.299943+0000","last_clean":"2023-01-24T22:03:50.299943+0000","last_became_active":"2023-01-24T22:03:50.299289+0000","last_became_peered":"2023-01-24T22:03:50.299289+0000","last_unstale":"2023-01-24T22:03:50.299943+0000","last_undegraded":"2023-01-24T22:03:50.299943+0000","last_fullsized":"2023-01-24T22:03:50.299943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.027373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.200982+0000","last_change":"2023-01-24T22:03:50.200541+0000","last_active":"2023-01-24T22:03:50.200982+0000","last_peered":"2023-01-24T22:03:50.200982+0000","last_clean":"2023-01-24T22:03:50.200982+0000","last_became_active":"2023-01-24T22:03:50.200024+0000","last_became_peered":"2023-01-24T22:03:50.200024+0000","last_unstale":"2023-01-24T22:03:50.200982+0000","last_undegraded":"2023-01-24T22:03:50.200982+0000","last_fullsized":"2023-01-24T22:03:50.200982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.332158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.208605+0000","last_change":"2023-01-24T22:03:50.208605+0000","last_active":"2023-01-24T22:03:50.208605+0000","last_peered":"2023-01-24T22:03:50.208605+0000","last_clean":"2023-01-24T22:03:50.208605+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:50.208605+0000","last_undegraded":"2023-01-24T22:03:50.208605+0000","last_fullsized":"2023-01-24T22:03:50.208605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:50.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3,"reported_epoch":19,"state":"creating+activating","last_fresh":"2023-01-24T22:03:50.301084+0000","last_change":"2023-01-24T22:03:50.301084+0000","last_active":"2023-01-24T22:03:49.173045+0000","last_peered":"2023-01-24T22:03:49.173045+0000","last_clean":"2023-01-24T22:03:49.173045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-24T22:03:50.301084+0000","last_undegraded":"2023-01-24T22:03:50.301084+0000","last_fullsized":"2023-01-24T22:03:50.301084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:56.594734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.433437+0000","last_change":"2023-01-24T22:03:50.433437+0000","last_active":"2023-01-24T22:03:50.433437+0000","last_peered":"2023-01-24T22:03:50.433437+0000","last_clean":"2023-01-24T22:03:50.433437+0000","last_became_active":"2023-01-24T22:03:50.432652+0000","last_became_peered":"2023-01-24T22:03:50.432652+0000","last_unstale":"2023-01-24T22:03:50.433437+0000","last_undegraded":"2023-01-24T22:03:50.433437+0000","last_fullsized":"2023-01-24T22:03:50.433437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:05.736584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.308556+0000","last_change":"2023-01-24T22:03:50.308556+0000","last_active":"2023-01-24T22:03:50.308556+0000","last_peered":"2023-01-24T22:03:50.308556+0000","last_clean":"2023-01-24T22:03:50.308556+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:50.308556+0000","last_undegraded":"2023-01-24T22:03:50.308556+0000","last_fullsized":"2023-01-24T22:03:50.308556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:59.467367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'51","reported_seq":82,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.350377+0000","last_change":"2023-01-24T22:03:46.525743+0000","last_active":"2023-01-24T22:03:51.350377+0000","last_peered":"2023-01-24T22:03:51.350377+0000","last_clean":"2023-01-24T22:03:51.350377+0000","last_became_active":"2023-01-24T22:03:46.423738+0000","last_became_peered":"2023-01-24T22:03:46.423738+0000","last_unstale":"2023-01-24T22:03:51.350377+0000","last_undegraded":"2023-01-24T22:03:51.350377+0000","last_fullsized":"2023-01-24T22:03:51.350377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_clean_scrub_stamp":"2023-01-24T22:03:45.139252+0000","objects_scrubbed":0,"log_size":51,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:09.515002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":83,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":83,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796820,"kb_used_data":92902888,"kb_used_omap":85,"kb_used_meta":0,"kb_avail":92902560,"statfs":{"total":95948165120,"available":95132221440,"internally_reserved":335872,"allocated":95132557312,"data_stored":95132557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87713,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795772,"kb_used_data":92903608,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903608,"statfs":{"total":95948165120,"available":95133294592,"internally_reserved":0,"allocated":95133294592,"data_stored":95133294592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43746,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795768,"kb_used_data":92903616,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903612,"statfs":{"total":95948165120,"available":95133298688,"internally_reserved":4096,"allocated":95133302784,"data_stored":95133302784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43828,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":67.619}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795644,"kb_used_data":92903736,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":92903736,"statfs":{"total":95948165120,"available":95133425664,"internally_reserved":0,"allocated":95133425664,"data_stored":95133425664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37718,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795632,"kb_used_data":92903748,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":92903748,"statfs":{"total":95948165120,"available":95133437952,"internally_reserved":0,"allocated":95133437952,"data_stored":95133437952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795840,"kb_used_data":92903556,"kb_used_omap":40,"kb_used_meta":0,"kb_avail":92903540,"statfs":{"total":95948165120,"available":95133224960,"internally_reserved":16384,"allocated":95133241344,"data_stored":95133241344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41531,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":85.819000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795852,"kb_used_data":92903556,"kb_used_omap":53,"kb_used_meta":0,"kb_avail":92903528,"statfs":{"total":95948165120,"available":95133212672,"internally_reserved":28672,"allocated":95133241344,"data_stored":95133241344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54409,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9820000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796812,"kb_used_data":92902888,"kb_used_omap":78,"kb_used_meta":0,"kb_avail":92902568,"statfs":{"total":95948165120,"available":95132229632,"internally_reserved":327680,"allocated":95132557312,"data_stored":95132557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":80018,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1749999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9460000000000002}]}]}],"pool_statfs":[]}} 2023-01-24T22:03:53.731 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-24T22:03:53.990 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:53.995 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-01-24T22:03:54.002 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-01-24T22:03:52.340736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":83,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6368140,"kb_used_data":743227596,"kb_used_omap":412,"kb_used_meta":0,"kb_avail":743226900,"statfs":{"total":767585320960,"available":761064345600,"internally_reserved":712704,"allocated":761065058304,"data_stored":761065058304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":422103,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":10,"commit_latency_ns":0,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262156,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":44,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.155182"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.209123+0000","last_change":"2023-01-24T22:03:50.209123+0000","last_active":"2023-01-24T22:03:50.209123+0000","last_peered":"2023-01-24T22:03:50.209123+0000","last_clean":"2023-01-24T22:03:50.209123+0000","last_became_active":"2023-01-24T22:03:50.208212+0000","last_became_peered":"2023-01-24T22:03:50.208212+0000","last_unstale":"2023-01-24T22:03:50.209123+0000","last_undegraded":"2023-01-24T22:03:50.209123+0000","last_fullsized":"2023-01-24T22:03:50.209123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:13.078024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.205813+0000","last_change":"2023-01-24T22:03:50.205463+0000","last_active":"2023-01-24T22:03:50.205813+0000","last_peered":"2023-01-24T22:03:50.205813+0000","last_clean":"2023-01-24T22:03:50.205813+0000","last_became_active":"2023-01-24T22:03:50.205045+0000","last_became_peered":"2023-01-24T22:03:50.205045+0000","last_unstale":"2023-01-24T22:03:50.205813+0000","last_undegraded":"2023-01-24T22:03:50.205813+0000","last_fullsized":"2023-01-24T22:03:50.205813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:10.456514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.299943+0000","last_change":"2023-01-24T22:03:50.299943+0000","last_active":"2023-01-24T22:03:50.299943+0000","last_peered":"2023-01-24T22:03:50.299943+0000","last_clean":"2023-01-24T22:03:50.299943+0000","last_became_active":"2023-01-24T22:03:50.299289+0000","last_became_peered":"2023-01-24T22:03:50.299289+0000","last_unstale":"2023-01-24T22:03:50.299943+0000","last_undegraded":"2023-01-24T22:03:50.299943+0000","last_fullsized":"2023-01-24T22:03:50.299943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.027373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.200982+0000","last_change":"2023-01-24T22:03:50.200541+0000","last_active":"2023-01-24T22:03:50.200982+0000","last_peered":"2023-01-24T22:03:50.200982+0000","last_clean":"2023-01-24T22:03:50.200982+0000","last_became_active":"2023-01-24T22:03:50.200024+0000","last_became_peered":"2023-01-24T22:03:50.200024+0000","last_unstale":"2023-01-24T22:03:50.200982+0000","last_undegraded":"2023-01-24T22:03:50.200982+0000","last_fullsized":"2023-01-24T22:03:50.200982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.332158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.208605+0000","last_change":"2023-01-24T22:03:50.208605+0000","last_active":"2023-01-24T22:03:50.208605+0000","last_peered":"2023-01-24T22:03:50.208605+0000","last_clean":"2023-01-24T22:03:50.208605+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:50.208605+0000","last_undegraded":"2023-01-24T22:03:50.208605+0000","last_fullsized":"2023-01-24T22:03:50.208605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:50.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3,"reported_epoch":19,"state":"creating+activating","last_fresh":"2023-01-24T22:03:50.301084+0000","last_change":"2023-01-24T22:03:50.301084+0000","last_active":"2023-01-24T22:03:49.173045+0000","last_peered":"2023-01-24T22:03:49.173045+0000","last_clean":"2023-01-24T22:03:49.173045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-24T22:03:50.301084+0000","last_undegraded":"2023-01-24T22:03:50.301084+0000","last_fullsized":"2023-01-24T22:03:50.301084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:56.594734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.433437+0000","last_change":"2023-01-24T22:03:50.433437+0000","last_active":"2023-01-24T22:03:50.433437+0000","last_peered":"2023-01-24T22:03:50.433437+0000","last_clean":"2023-01-24T22:03:50.433437+0000","last_became_active":"2023-01-24T22:03:50.432652+0000","last_became_peered":"2023-01-24T22:03:50.432652+0000","last_unstale":"2023-01-24T22:03:50.433437+0000","last_undegraded":"2023-01-24T22:03:50.433437+0000","last_fullsized":"2023-01-24T22:03:50.433437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:05.736584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.308556+0000","last_change":"2023-01-24T22:03:50.308556+0000","last_active":"2023-01-24T22:03:50.308556+0000","last_peered":"2023-01-24T22:03:50.308556+0000","last_clean":"2023-01-24T22:03:50.308556+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:50.308556+0000","last_undegraded":"2023-01-24T22:03:50.308556+0000","last_fullsized":"2023-01-24T22:03:50.308556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:59.467367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'51","reported_seq":82,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.350377+0000","last_change":"2023-01-24T22:03:46.525743+0000","last_active":"2023-01-24T22:03:51.350377+0000","last_peered":"2023-01-24T22:03:51.350377+0000","last_clean":"2023-01-24T22:03:51.350377+0000","last_became_active":"2023-01-24T22:03:46.423738+0000","last_became_peered":"2023-01-24T22:03:46.423738+0000","last_unstale":"2023-01-24T22:03:51.350377+0000","last_undegraded":"2023-01-24T22:03:51.350377+0000","last_fullsized":"2023-01-24T22:03:51.350377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_clean_scrub_stamp":"2023-01-24T22:03:45.139252+0000","objects_scrubbed":0,"log_size":51,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:09.515002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":83,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":83,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796820,"kb_used_data":92902888,"kb_used_omap":85,"kb_used_meta":0,"kb_avail":92902560,"statfs":{"total":95948165120,"available":95132221440,"internally_reserved":335872,"allocated":95132557312,"data_stored":95132557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87713,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795772,"kb_used_data":92903608,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903608,"statfs":{"total":95948165120,"available":95133294592,"internally_reserved":0,"allocated":95133294592,"data_stored":95133294592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43746,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795768,"kb_used_data":92903616,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903612,"statfs":{"total":95948165120,"available":95133298688,"internally_reserved":4096,"allocated":95133302784,"data_stored":95133302784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43828,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":67.619}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795644,"kb_used_data":92903736,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":92903736,"statfs":{"total":95948165120,"available":95133425664,"internally_reserved":0,"allocated":95133425664,"data_stored":95133425664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37718,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795632,"kb_used_data":92903748,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":92903748,"statfs":{"total":95948165120,"available":95133437952,"internally_reserved":0,"allocated":95133437952,"data_stored":95133437952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795840,"kb_used_data":92903556,"kb_used_omap":40,"kb_used_meta":0,"kb_avail":92903540,"statfs":{"total":95948165120,"available":95133224960,"internally_reserved":16384,"allocated":95133241344,"data_stored":95133241344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41531,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":85.819000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795852,"kb_used_data":92903556,"kb_used_omap":53,"kb_used_meta":0,"kb_avail":92903528,"statfs":{"total":95948165120,"available":95133212672,"internally_reserved":28672,"allocated":95133241344,"data_stored":95133241344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54409,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9820000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796812,"kb_used_data":92902888,"kb_used_omap":78,"kb_used_meta":0,"kb_avail":92902568,"statfs":{"total":95948165120,"available":95132229632,"internally_reserved":327680,"allocated":95132557312,"data_stored":95132557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":80018,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1749999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9460000000000002}]}]}],"pool_statfs":[]}} 2023-01-24T22:03:54.004 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-24T22:03:54.256 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:54.259 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-01-24T22:03:54.269 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-01-24T22:03:52.340736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":83,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6368140,"kb_used_data":743227596,"kb_used_omap":412,"kb_used_meta":0,"kb_avail":743226900,"statfs":{"total":767585320960,"available":761064345600,"internally_reserved":712704,"allocated":761065058304,"data_stored":761065058304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":422103,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":10,"commit_latency_ns":0,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":262156,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":44,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.155182"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.209123+0000","last_change":"2023-01-24T22:03:50.209123+0000","last_active":"2023-01-24T22:03:50.209123+0000","last_peered":"2023-01-24T22:03:50.209123+0000","last_clean":"2023-01-24T22:03:50.209123+0000","last_became_active":"2023-01-24T22:03:50.208212+0000","last_became_peered":"2023-01-24T22:03:50.208212+0000","last_unstale":"2023-01-24T22:03:50.209123+0000","last_undegraded":"2023-01-24T22:03:50.209123+0000","last_fullsized":"2023-01-24T22:03:50.209123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:13.078024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.205813+0000","last_change":"2023-01-24T22:03:50.205463+0000","last_active":"2023-01-24T22:03:50.205813+0000","last_peered":"2023-01-24T22:03:50.205813+0000","last_clean":"2023-01-24T22:03:50.205813+0000","last_became_active":"2023-01-24T22:03:50.205045+0000","last_became_peered":"2023-01-24T22:03:50.205045+0000","last_unstale":"2023-01-24T22:03:50.205813+0000","last_undegraded":"2023-01-24T22:03:50.205813+0000","last_fullsized":"2023-01-24T22:03:50.205813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:10.456514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.299943+0000","last_change":"2023-01-24T22:03:50.299943+0000","last_active":"2023-01-24T22:03:50.299943+0000","last_peered":"2023-01-24T22:03:50.299943+0000","last_clean":"2023-01-24T22:03:50.299943+0000","last_became_active":"2023-01-24T22:03:50.299289+0000","last_became_peered":"2023-01-24T22:03:50.299289+0000","last_unstale":"2023-01-24T22:03:50.299943+0000","last_undegraded":"2023-01-24T22:03:50.299943+0000","last_fullsized":"2023-01-24T22:03:50.299943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.027373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.200982+0000","last_change":"2023-01-24T22:03:50.200541+0000","last_active":"2023-01-24T22:03:50.200982+0000","last_peered":"2023-01-24T22:03:50.200982+0000","last_clean":"2023-01-24T22:03:50.200982+0000","last_became_active":"2023-01-24T22:03:50.200024+0000","last_became_peered":"2023-01-24T22:03:50.200024+0000","last_unstale":"2023-01-24T22:03:50.200982+0000","last_undegraded":"2023-01-24T22:03:50.200982+0000","last_fullsized":"2023-01-24T22:03:50.200982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.332158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.208605+0000","last_change":"2023-01-24T22:03:50.208605+0000","last_active":"2023-01-24T22:03:50.208605+0000","last_peered":"2023-01-24T22:03:50.208605+0000","last_clean":"2023-01-24T22:03:50.208605+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:50.208605+0000","last_undegraded":"2023-01-24T22:03:50.208605+0000","last_fullsized":"2023-01-24T22:03:50.208605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:50.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3,"reported_epoch":19,"state":"creating+activating","last_fresh":"2023-01-24T22:03:50.301084+0000","last_change":"2023-01-24T22:03:50.301084+0000","last_active":"2023-01-24T22:03:49.173045+0000","last_peered":"2023-01-24T22:03:49.173045+0000","last_clean":"2023-01-24T22:03:49.173045+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-24T22:03:50.301084+0000","last_undegraded":"2023-01-24T22:03:50.301084+0000","last_fullsized":"2023-01-24T22:03:50.301084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:56.594734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.433437+0000","last_change":"2023-01-24T22:03:50.433437+0000","last_active":"2023-01-24T22:03:50.433437+0000","last_peered":"2023-01-24T22:03:50.433437+0000","last_clean":"2023-01-24T22:03:50.433437+0000","last_became_active":"2023-01-24T22:03:50.432652+0000","last_became_peered":"2023-01-24T22:03:50.432652+0000","last_unstale":"2023-01-24T22:03:50.433437+0000","last_undegraded":"2023-01-24T22:03:50.433437+0000","last_fullsized":"2023-01-24T22:03:50.433437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:05.736584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:50.308556+0000","last_change":"2023-01-24T22:03:50.308556+0000","last_active":"2023-01-24T22:03:50.308556+0000","last_peered":"2023-01-24T22:03:50.308556+0000","last_clean":"2023-01-24T22:03:50.308556+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:50.308556+0000","last_undegraded":"2023-01-24T22:03:50.308556+0000","last_fullsized":"2023-01-24T22:03:50.308556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:59.467367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'51","reported_seq":82,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.350377+0000","last_change":"2023-01-24T22:03:46.525743+0000","last_active":"2023-01-24T22:03:51.350377+0000","last_peered":"2023-01-24T22:03:51.350377+0000","last_clean":"2023-01-24T22:03:51.350377+0000","last_became_active":"2023-01-24T22:03:46.423738+0000","last_became_peered":"2023-01-24T22:03:46.423738+0000","last_unstale":"2023-01-24T22:03:51.350377+0000","last_undegraded":"2023-01-24T22:03:51.350377+0000","last_fullsized":"2023-01-24T22:03:51.350377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_clean_scrub_stamp":"2023-01-24T22:03:45.139252+0000","objects_scrubbed":0,"log_size":51,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:09.515002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":83,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":61,"num_write":83,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796820,"kb_used_data":92902888,"kb_used_omap":85,"kb_used_meta":0,"kb_avail":92902560,"statfs":{"total":95948165120,"available":95132221440,"internally_reserved":335872,"allocated":95132557312,"data_stored":95132557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":87713,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795772,"kb_used_data":92903608,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903608,"statfs":{"total":95948165120,"available":95133294592,"internally_reserved":0,"allocated":95133294592,"data_stored":95133294592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43746,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795768,"kb_used_data":92903616,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903612,"statfs":{"total":95948165120,"available":95133298688,"internally_reserved":4096,"allocated":95133302784,"data_stored":95133302784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43828,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":67.619}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795644,"kb_used_data":92903736,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":92903736,"statfs":{"total":95948165120,"available":95133425664,"internally_reserved":0,"allocated":95133425664,"data_stored":95133425664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37718,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795632,"kb_used_data":92903748,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":92903748,"statfs":{"total":95948165120,"available":95133437952,"internally_reserved":0,"allocated":95133437952,"data_stored":95133437952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795840,"kb_used_data":92903556,"kb_used_omap":40,"kb_used_meta":0,"kb_avail":92903540,"statfs":{"total":95948165120,"available":95133224960,"internally_reserved":16384,"allocated":95133241344,"data_stored":95133241344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41531,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":85.819000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795852,"kb_used_data":92903556,"kb_used_omap":53,"kb_used_meta":0,"kb_avail":92903528,"statfs":{"total":95948165120,"available":95133212672,"internally_reserved":28672,"allocated":95133241344,"data_stored":95133241344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54409,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9820000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796812,"kb_used_data":92902888,"kb_used_omap":78,"kb_used_meta":0,"kb_avail":92902568,"statfs":{"total":95948165120,"available":95132229632,"internally_reserved":327680,"allocated":95132557312,"data_stored":95132557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":80018,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1749999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9460000000000002}]}]}],"pool_statfs":[]}} 2023-01-24T22:03:54.271 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2023-01-24T22:03:54.272 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 19, 'state': 'creating+activating', 'last_fresh': '2023-01-24T22:03:50.301084+0000', 'last_change': '2023-01-24T22:03:50.301084+0000', 'last_active': '2023-01-24T22:03:49.173045+0000', 'last_peered': '2023-01-24T22:03:49.173045+0000', 'last_clean': '2023-01-24T22:03:49.173045+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-01-24T22:03:50.301084+0000', 'last_undegraded': '2023-01-24T22:03:50.301084+0000', 'last_fullsized': '2023-01-24T22:03:50.301084+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-01-24T22:03:49.173045+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-01-24T22:03:49.173045+0000', 'last_clean_scrub_stamp': '2023-01-24T22:03:49.173045+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-01-24T22:04:56.594734+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-01-24T22:03:54.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-01-24T22:03:54.594 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:54.595 INFO:teuthology.orchestra.run.smithi100.stdout:{"fsid":"2db70b95-3a95-440a-afc1-b7f5c81bdc31","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":16,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1674597823,"num_in_osds":8,"osd_in_since":1674597820,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":8},{"state_name":"creating+activating","count":1}],"num_pgs":9,"num_pools":2,"num_objects":2,"data_bytes":459280,"bytes_used":6520975360,"bytes_avail":761064345600,"bytes_total":767585320960,"inactive_pgs_ratio":0.1111111119389534,"read_bytes_sec":11359,"write_bytes_sec":211603,"read_op_per_sec":12,"write_op_per_sec":13},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-01-24T22:03:38.029563+0000","services":{}},"progress_events":{}} 2023-01-24T22:03:54.609 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2023-01-24T22:03:54.609 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-24T22:03:54.874 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:54.877 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-01-24T22:03:54.886 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-01-24T22:03:54.341021+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":116,"num_write_kb":1375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6370936,"kb_used_data":743226180,"kb_used_omap":452,"kb_used_meta":0,"kb_avail":743224104,"statfs":{"total":767585320960,"available":761061482496,"internally_reserved":2125824,"allocated":761063608320,"data_stored":761063608320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":463017,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":393244,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":77,"num_write_kb":1179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.155467"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:52.627852+0000","last_change":"2023-01-24T22:03:50.209123+0000","last_active":"2023-01-24T22:03:52.627852+0000","last_peered":"2023-01-24T22:03:52.627852+0000","last_clean":"2023-01-24T22:03:52.627852+0000","last_became_active":"2023-01-24T22:03:50.208212+0000","last_became_peered":"2023-01-24T22:03:50.208212+0000","last_unstale":"2023-01-24T22:03:52.627852+0000","last_undegraded":"2023-01-24T22:03:52.627852+0000","last_fullsized":"2023-01-24T22:03:52.627852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:13.078024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.213472+0000","last_change":"2023-01-24T22:03:50.205463+0000","last_active":"2023-01-24T22:03:51.213472+0000","last_peered":"2023-01-24T22:03:51.213472+0000","last_clean":"2023-01-24T22:03:51.213472+0000","last_became_active":"2023-01-24T22:03:50.205045+0000","last_became_peered":"2023-01-24T22:03:50.205045+0000","last_unstale":"2023-01-24T22:03:51.213472+0000","last_undegraded":"2023-01-24T22:03:51.213472+0000","last_fullsized":"2023-01-24T22:03:51.213472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:10.456514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.843372+0000","last_change":"2023-01-24T22:03:50.299943+0000","last_active":"2023-01-24T22:03:51.843372+0000","last_peered":"2023-01-24T22:03:51.843372+0000","last_clean":"2023-01-24T22:03:51.843372+0000","last_became_active":"2023-01-24T22:03:50.299289+0000","last_became_peered":"2023-01-24T22:03:50.299289+0000","last_unstale":"2023-01-24T22:03:51.843372+0000","last_undegraded":"2023-01-24T22:03:51.843372+0000","last_fullsized":"2023-01-24T22:03:51.843372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.027373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.213464+0000","last_change":"2023-01-24T22:03:50.200541+0000","last_active":"2023-01-24T22:03:51.213464+0000","last_peered":"2023-01-24T22:03:51.213464+0000","last_clean":"2023-01-24T22:03:51.213464+0000","last_became_active":"2023-01-24T22:03:50.200024+0000","last_became_peered":"2023-01-24T22:03:50.200024+0000","last_unstale":"2023-01-24T22:03:51.213464+0000","last_undegraded":"2023-01-24T22:03:51.213464+0000","last_fullsized":"2023-01-24T22:03:51.213464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.332158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.863591+0000","last_change":"2023-01-24T22:03:50.208605+0000","last_active":"2023-01-24T22:03:51.863591+0000","last_peered":"2023-01-24T22:03:51.863591+0000","last_clean":"2023-01-24T22:03:51.863591+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:51.863591+0000","last_undegraded":"2023-01-24T22:03:51.863591+0000","last_fullsized":"2023-01-24T22:03:51.863591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:50.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.600869+0000","last_change":"2023-01-24T22:03:51.600603+0000","last_active":"2023-01-24T22:03:51.600869+0000","last_peered":"2023-01-24T22:03:51.600869+0000","last_clean":"2023-01-24T22:03:51.600869+0000","last_became_active":"2023-01-24T22:03:51.500182+0000","last_became_peered":"2023-01-24T22:03:51.500182+0000","last_unstale":"2023-01-24T22:03:51.600869+0000","last_undegraded":"2023-01-24T22:03:51.600869+0000","last_fullsized":"2023-01-24T22:03:51.600869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:56.594734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.843417+0000","last_change":"2023-01-24T22:03:50.433437+0000","last_active":"2023-01-24T22:03:51.843417+0000","last_peered":"2023-01-24T22:03:51.843417+0000","last_clean":"2023-01-24T22:03:51.843417+0000","last_became_active":"2023-01-24T22:03:50.432652+0000","last_became_peered":"2023-01-24T22:03:50.432652+0000","last_unstale":"2023-01-24T22:03:51.843417+0000","last_undegraded":"2023-01-24T22:03:51.843417+0000","last_fullsized":"2023-01-24T22:03:51.843417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:05.736584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.963807+0000","last_change":"2023-01-24T22:03:50.308556+0000","last_active":"2023-01-24T22:03:51.963807+0000","last_peered":"2023-01-24T22:03:51.963807+0000","last_clean":"2023-01-24T22:03:51.963807+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:51.963807+0000","last_undegraded":"2023-01-24T22:03:51.963807+0000","last_fullsized":"2023-01-24T22:03:51.963807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:59.467367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"21'79","reported_seq":118,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-01-24T22:03:53.254568+0000","last_change":"2023-01-24T22:03:46.525743+0000","last_active":"2023-01-24T22:03:53.254568+0000","last_peered":"2023-01-24T22:03:53.254568+0000","last_clean":"2023-01-24T22:03:53.254568+0000","last_became_active":"2023-01-24T22:03:46.423738+0000","last_became_peered":"2023-01-24T22:03:46.423738+0000","last_unstale":"2023-01-24T22:03:53.254568+0000","last_undegraded":"2023-01-24T22:03:53.254568+0000","last_fullsized":"2023-01-24T22:03:53.254568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_clean_scrub_stamp":"2023-01-24T22:03:45.139252+0000","objects_scrubbed":0,"log_size":79,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:09.515002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":116,"num_write_kb":1375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":116,"num_write_kb":1375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797496,"kb_used_data":92902808,"kb_used_omap":101,"kb_used_meta":0,"kb_avail":92901884,"statfs":{"total":95948165120,"available":95131529216,"internally_reserved":946176,"allocated":95132475392,"data_stored":95132475392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":103604,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.446999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.666}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795892,"kb_used_data":92903504,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903488,"statfs":{"total":95948165120,"available":95133171712,"internally_reserved":16384,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43822,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795888,"kb_used_data":92903512,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903492,"statfs":{"total":95948165120,"available":95133175808,"internally_reserved":20480,"allocated":95133196288,"data_stored":95133196288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43904,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":67.619}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795764,"kb_used_data":92903632,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":92903616,"statfs":{"total":95948165120,"available":95133302784,"internally_reserved":16384,"allocated":95133319168,"data_stored":95133319168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37794,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795956,"kb_used_data":92903464,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903424,"statfs":{"total":95948165120,"available":95133106176,"internally_reserved":40960,"allocated":95133147136,"data_stored":95133147136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38478,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795908,"kb_used_data":92903504,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903472,"statfs":{"total":95948165120,"available":95133155328,"internally_reserved":32768,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43940,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":85.819000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795912,"kb_used_data":92903504,"kb_used_omap":53,"kb_used_meta":0,"kb_avail":92903468,"statfs":{"total":95948165120,"available":95133151232,"internally_reserved":36864,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54447,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92902252,"kb_used_omap":94,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":1015808,"allocated":95131906048,"data_stored":95131906048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":97028,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]}],"pool_statfs":[]}} 2023-01-24T22:03:57.888 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-24T22:03:58.185 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-01-24T22:03:58.200 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-01-24T22:03:56.341498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":116,"num_write_kb":1375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6370936,"kb_used_data":743226180,"kb_used_omap":452,"kb_used_meta":0,"kb_avail":743224104,"statfs":{"total":767585320960,"available":761061482496,"internally_reserved":2125824,"allocated":761063608320,"data_stored":761063608320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":463017,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":393244,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":77,"num_write_kb":1179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.145935"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:52.627852+0000","last_change":"2023-01-24T22:03:50.209123+0000","last_active":"2023-01-24T22:03:52.627852+0000","last_peered":"2023-01-24T22:03:52.627852+0000","last_clean":"2023-01-24T22:03:52.627852+0000","last_became_active":"2023-01-24T22:03:50.208212+0000","last_became_peered":"2023-01-24T22:03:50.208212+0000","last_unstale":"2023-01-24T22:03:52.627852+0000","last_undegraded":"2023-01-24T22:03:52.627852+0000","last_fullsized":"2023-01-24T22:03:52.627852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:13.078024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.213472+0000","last_change":"2023-01-24T22:03:50.205463+0000","last_active":"2023-01-24T22:03:51.213472+0000","last_peered":"2023-01-24T22:03:51.213472+0000","last_clean":"2023-01-24T22:03:51.213472+0000","last_became_active":"2023-01-24T22:03:50.205045+0000","last_became_peered":"2023-01-24T22:03:50.205045+0000","last_unstale":"2023-01-24T22:03:51.213472+0000","last_undegraded":"2023-01-24T22:03:51.213472+0000","last_fullsized":"2023-01-24T22:03:51.213472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:10.456514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.843372+0000","last_change":"2023-01-24T22:03:50.299943+0000","last_active":"2023-01-24T22:03:51.843372+0000","last_peered":"2023-01-24T22:03:51.843372+0000","last_clean":"2023-01-24T22:03:51.843372+0000","last_became_active":"2023-01-24T22:03:50.299289+0000","last_became_peered":"2023-01-24T22:03:50.299289+0000","last_unstale":"2023-01-24T22:03:51.843372+0000","last_undegraded":"2023-01-24T22:03:51.843372+0000","last_fullsized":"2023-01-24T22:03:51.843372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.027373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.213464+0000","last_change":"2023-01-24T22:03:50.200541+0000","last_active":"2023-01-24T22:03:51.213464+0000","last_peered":"2023-01-24T22:03:51.213464+0000","last_clean":"2023-01-24T22:03:51.213464+0000","last_became_active":"2023-01-24T22:03:50.200024+0000","last_became_peered":"2023-01-24T22:03:50.200024+0000","last_unstale":"2023-01-24T22:03:51.213464+0000","last_undegraded":"2023-01-24T22:03:51.213464+0000","last_fullsized":"2023-01-24T22:03:51.213464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.332158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.863591+0000","last_change":"2023-01-24T22:03:50.208605+0000","last_active":"2023-01-24T22:03:51.863591+0000","last_peered":"2023-01-24T22:03:51.863591+0000","last_clean":"2023-01-24T22:03:51.863591+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:51.863591+0000","last_undegraded":"2023-01-24T22:03:51.863591+0000","last_fullsized":"2023-01-24T22:03:51.863591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:50.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.600869+0000","last_change":"2023-01-24T22:03:51.600603+0000","last_active":"2023-01-24T22:03:51.600869+0000","last_peered":"2023-01-24T22:03:51.600869+0000","last_clean":"2023-01-24T22:03:51.600869+0000","last_became_active":"2023-01-24T22:03:51.500182+0000","last_became_peered":"2023-01-24T22:03:51.500182+0000","last_unstale":"2023-01-24T22:03:51.600869+0000","last_undegraded":"2023-01-24T22:03:51.600869+0000","last_fullsized":"2023-01-24T22:03:51.600869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:56.594734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.843417+0000","last_change":"2023-01-24T22:03:50.433437+0000","last_active":"2023-01-24T22:03:51.843417+0000","last_peered":"2023-01-24T22:03:51.843417+0000","last_clean":"2023-01-24T22:03:51.843417+0000","last_became_active":"2023-01-24T22:03:50.432652+0000","last_became_peered":"2023-01-24T22:03:50.432652+0000","last_unstale":"2023-01-24T22:03:51.843417+0000","last_undegraded":"2023-01-24T22:03:51.843417+0000","last_fullsized":"2023-01-24T22:03:51.843417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:05.736584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.963807+0000","last_change":"2023-01-24T22:03:50.308556+0000","last_active":"2023-01-24T22:03:51.963807+0000","last_peered":"2023-01-24T22:03:51.963807+0000","last_clean":"2023-01-24T22:03:51.963807+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:51.963807+0000","last_undegraded":"2023-01-24T22:03:51.963807+0000","last_fullsized":"2023-01-24T22:03:51.963807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:59.467367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"21'79","reported_seq":118,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-01-24T22:03:53.254568+0000","last_change":"2023-01-24T22:03:46.525743+0000","last_active":"2023-01-24T22:03:53.254568+0000","last_peered":"2023-01-24T22:03:53.254568+0000","last_clean":"2023-01-24T22:03:53.254568+0000","last_became_active":"2023-01-24T22:03:46.423738+0000","last_became_peered":"2023-01-24T22:03:46.423738+0000","last_unstale":"2023-01-24T22:03:53.254568+0000","last_undegraded":"2023-01-24T22:03:53.254568+0000","last_fullsized":"2023-01-24T22:03:53.254568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_clean_scrub_stamp":"2023-01-24T22:03:45.139252+0000","objects_scrubbed":0,"log_size":79,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:09.515002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":116,"num_write_kb":1375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":80,"num_write":116,"num_write_kb":1375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797496,"kb_used_data":92902808,"kb_used_omap":101,"kb_used_meta":0,"kb_avail":92901884,"statfs":{"total":95948165120,"available":95131529216,"internally_reserved":946176,"allocated":95132475392,"data_stored":95132475392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":103604,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.446999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.666}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795892,"kb_used_data":92903504,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903488,"statfs":{"total":95948165120,"available":95133171712,"internally_reserved":16384,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43822,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795888,"kb_used_data":92903512,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903492,"statfs":{"total":95948165120,"available":95133175808,"internally_reserved":20480,"allocated":95133196288,"data_stored":95133196288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43904,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":67.619}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795764,"kb_used_data":92903632,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":92903616,"statfs":{"total":95948165120,"available":95133302784,"internally_reserved":16384,"allocated":95133319168,"data_stored":95133319168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37794,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795956,"kb_used_data":92903464,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903424,"statfs":{"total":95948165120,"available":95133106176,"internally_reserved":40960,"allocated":95133147136,"data_stored":95133147136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38478,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795908,"kb_used_data":92903504,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903472,"statfs":{"total":95948165120,"available":95133155328,"internally_reserved":32768,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43940,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":85.819000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795912,"kb_used_data":92903504,"kb_used_omap":53,"kb_used_meta":0,"kb_avail":92903468,"statfs":{"total":95948165120,"available":95133151232,"internally_reserved":36864,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54447,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":798120,"kb_used_data":92902252,"kb_used_omap":94,"kb_used_meta":0,"kb_avail":92901260,"statfs":{"total":95948165120,"available":95130890240,"internally_reserved":1015808,"allocated":95131906048,"data_stored":95131906048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":97028,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]}],"pool_statfs":[]}} 2023-01-24T22:03:58.201 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-24T22:03:58.202 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-24T22:03:58.202 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-01-24T22:03:58.202 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-01-24T22:03:58.517 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:03:58.518 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-24T22:03:58.531 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-01-24T22:03:58.531 INFO:teuthology.run_tasks:Running task exec... 2023-01-24T22:03:58.542 INFO:teuthology.task.exec:Executing custom commands... 2023-01-24T22:03:58.543 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2023-01-24T22:03:58.543 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'while ! ceph balancer status ; do sleep 1 ; done' 2023-01-24T22:03:58.829 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-01-24T22:03:58.829 INFO:teuthology.orchestra.run.smithi100.stdout: "active": true, 2023-01-24T22:03:58.829 INFO:teuthology.orchestra.run.smithi100.stdout: "last_optimize_duration": "0:00:00.000799", 2023-01-24T22:03:58.830 INFO:teuthology.orchestra.run.smithi100.stdout: "last_optimize_started": "Tue Jan 24 22:03:42 2023", 2023-01-24T22:03:58.830 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "upmap", 2023-01-24T22:03:58.830 INFO:teuthology.orchestra.run.smithi100.stdout: "no_optimization_needed": false, 2023-01-24T22:03:58.830 INFO:teuthology.orchestra.run.smithi100.stdout: "optimize_result": "No pools available", 2023-01-24T22:03:58.831 INFO:teuthology.orchestra.run.smithi100.stdout: "plans": [] 2023-01-24T22:03:58.831 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-01-24T22:03:58.843 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer mode crush-compat' 2023-01-24T22:03:59.833 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer on' 2023-01-24T22:04:00.129 INFO:teuthology.run_tasks:Running task thrashosds... 2023-01-24T22:04:00.144 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 0.25, 'chance_pgnum_shrink': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-01-24T22:04:00.144 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-yuri7-testing-2023-01-23-1532-quincy'}, 'ceph': {'conf': {'global': {'mon election default strategy': 1, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_async_recovery_min_cost': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluestore zero block detection': True, 'debug ms': 1, 'debug osd': 20, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'filestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'must scrub before tier agent can activate'], 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'}}, 'workunit': {'branch': 'wip-yuri7-testing-2023-01-23-1532-quincy', 'sha1': '49f8fb05584886826e8eade75f7105fba754560c'}} 2023-01-24T22:04:00.145 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 0.25, 'chance_pgnum_shrink': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-01-24T22:04:00.145 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-01-24T22:04:00.455 INFO:tasks.thrashosds:Beginning thrashosds... 2023-01-24T22:04:00.456 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-24T22:04:00.456 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-24T22:04:00.734 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:04:00.737 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-01-24T22:04:00.748 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-01-24T22:04:00.342637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6369892,"kb_used_data":743226388,"kb_used_omap":495,"kb_used_meta":0,"kb_avail":743225148,"statfs":{"total":767585320960,"available":761062551552,"internally_reserved":1269760,"allocated":761063821312,"data_stored":761063821312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507367,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5,0,0,6,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131088,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":76,"num_write_kb":1568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.117288"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:52.627852+0000","last_change":"2023-01-24T22:03:50.209123+0000","last_active":"2023-01-24T22:03:52.627852+0000","last_peered":"2023-01-24T22:03:52.627852+0000","last_clean":"2023-01-24T22:03:52.627852+0000","last_became_active":"2023-01-24T22:03:50.208212+0000","last_became_peered":"2023-01-24T22:03:50.208212+0000","last_unstale":"2023-01-24T22:03:52.627852+0000","last_undegraded":"2023-01-24T22:03:52.627852+0000","last_fullsized":"2023-01-24T22:03:52.627852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:13.078024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.213472+0000","last_change":"2023-01-24T22:03:50.205463+0000","last_active":"2023-01-24T22:03:51.213472+0000","last_peered":"2023-01-24T22:03:51.213472+0000","last_clean":"2023-01-24T22:03:51.213472+0000","last_became_active":"2023-01-24T22:03:50.205045+0000","last_became_peered":"2023-01-24T22:03:50.205045+0000","last_unstale":"2023-01-24T22:03:51.213472+0000","last_undegraded":"2023-01-24T22:03:51.213472+0000","last_fullsized":"2023-01-24T22:03:51.213472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:10.456514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.843372+0000","last_change":"2023-01-24T22:03:50.299943+0000","last_active":"2023-01-24T22:03:51.843372+0000","last_peered":"2023-01-24T22:03:51.843372+0000","last_clean":"2023-01-24T22:03:51.843372+0000","last_became_active":"2023-01-24T22:03:50.299289+0000","last_became_peered":"2023-01-24T22:03:50.299289+0000","last_unstale":"2023-01-24T22:03:51.843372+0000","last_undegraded":"2023-01-24T22:03:51.843372+0000","last_fullsized":"2023-01-24T22:03:51.843372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.027373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.213464+0000","last_change":"2023-01-24T22:03:50.200541+0000","last_active":"2023-01-24T22:03:51.213464+0000","last_peered":"2023-01-24T22:03:51.213464+0000","last_clean":"2023-01-24T22:03:51.213464+0000","last_became_active":"2023-01-24T22:03:50.200024+0000","last_became_peered":"2023-01-24T22:03:50.200024+0000","last_unstale":"2023-01-24T22:03:51.213464+0000","last_undegraded":"2023-01-24T22:03:51.213464+0000","last_fullsized":"2023-01-24T22:03:51.213464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.332158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.863591+0000","last_change":"2023-01-24T22:03:50.208605+0000","last_active":"2023-01-24T22:03:51.863591+0000","last_peered":"2023-01-24T22:03:51.863591+0000","last_clean":"2023-01-24T22:03:51.863591+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:51.863591+0000","last_undegraded":"2023-01-24T22:03:51.863591+0000","last_fullsized":"2023-01-24T22:03:51.863591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:50.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.600869+0000","last_change":"2023-01-24T22:03:51.600603+0000","last_active":"2023-01-24T22:03:51.600869+0000","last_peered":"2023-01-24T22:03:51.600869+0000","last_clean":"2023-01-24T22:03:51.600869+0000","last_became_active":"2023-01-24T22:03:51.500182+0000","last_became_peered":"2023-01-24T22:03:51.500182+0000","last_unstale":"2023-01-24T22:03:51.600869+0000","last_undegraded":"2023-01-24T22:03:51.600869+0000","last_fullsized":"2023-01-24T22:03:51.600869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:56.594734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.843417+0000","last_change":"2023-01-24T22:03:50.433437+0000","last_active":"2023-01-24T22:03:51.843417+0000","last_peered":"2023-01-24T22:03:51.843417+0000","last_clean":"2023-01-24T22:03:51.843417+0000","last_became_active":"2023-01-24T22:03:50.432652+0000","last_became_peered":"2023-01-24T22:03:50.432652+0000","last_unstale":"2023-01-24T22:03:51.843417+0000","last_undegraded":"2023-01-24T22:03:51.843417+0000","last_fullsized":"2023-01-24T22:03:51.843417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:05.736584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.963807+0000","last_change":"2023-01-24T22:03:50.308556+0000","last_active":"2023-01-24T22:03:51.963807+0000","last_peered":"2023-01-24T22:03:51.963807+0000","last_clean":"2023-01-24T22:03:51.963807+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:51.963807+0000","last_undegraded":"2023-01-24T22:03:51.963807+0000","last_fullsized":"2023-01-24T22:03:51.963807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:59.467367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"21'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-01-24T22:03:57.183249+0000","last_change":"2023-01-24T22:03:46.525743+0000","last_active":"2023-01-24T22:03:57.183249+0000","last_peered":"2023-01-24T22:03:57.183249+0000","last_clean":"2023-01-24T22:03:57.183249+0000","last_became_active":"2023-01-24T22:03:46.423738+0000","last_became_peered":"2023-01-24T22:03:46.423738+0000","last_unstale":"2023-01-24T22:03:57.183249+0000","last_undegraded":"2023-01-24T22:03:57.183249+0000","last_fullsized":"2023-01-24T22:03:57.183249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_clean_scrub_stamp":"2023-01-24T22:03:45.139252+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:09.515002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797624,"kb_used_data":92902376,"kb_used_omap":123,"kb_used_meta":0,"kb_avail":92901756,"statfs":{"total":95948165120,"available":95131398144,"internally_reserved":634880,"allocated":95132033024,"data_stored":95132033024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":126452,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5,0,0,6,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795796,"kb_used_data":92903584,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903584,"statfs":{"total":95948165120,"available":95133270016,"internally_reserved":0,"allocated":95133270016,"data_stored":95133270016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43872,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795788,"kb_used_data":92903592,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903592,"statfs":{"total":95948165120,"available":95133278208,"internally_reserved":0,"allocated":95133278208,"data_stored":95133278208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43954,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795668,"kb_used_data":92903712,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":92903712,"statfs":{"total":95948165120,"available":95133401088,"internally_reserved":0,"allocated":95133401088,"data_stored":95133401088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37844,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795796,"kb_used_data":92903584,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903584,"statfs":{"total":95948165120,"available":95133270016,"internally_reserved":0,"allocated":95133270016,"data_stored":95133270016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38528,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795796,"kb_used_data":92903584,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903584,"statfs":{"total":95948165120,"available":95133270016,"internally_reserved":0,"allocated":95133270016,"data_stored":95133270016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43990,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795796,"kb_used_data":92903584,"kb_used_omap":53,"kb_used_meta":0,"kb_avail":92903584,"statfs":{"total":95948165120,"available":95133270016,"internally_reserved":0,"allocated":95133270016,"data_stored":95133270016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54497,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797628,"kb_used_data":92902372,"kb_used_omap":115,"kb_used_meta":0,"kb_avail":92901752,"statfs":{"total":95948165120,"available":95131394048,"internally_reserved":634880,"allocated":95132028928,"data_stored":95132028928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":118230,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]}]}],"pool_statfs":[]}} 2023-01-24T22:04:00.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-24T22:04:01.028 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-01-24T22:04:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2023-01-24T22:04:01.042 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-01-24T22:04:00.342637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6369892,"kb_used_data":743226388,"kb_used_omap":495,"kb_used_meta":0,"kb_avail":743225148,"statfs":{"total":767585320960,"available":761062551552,"internally_reserved":1269760,"allocated":761063821312,"data_stored":761063821312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507367,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5,0,0,6,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131088,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":76,"num_write_kb":1568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.117288"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:52.627852+0000","last_change":"2023-01-24T22:03:50.209123+0000","last_active":"2023-01-24T22:03:52.627852+0000","last_peered":"2023-01-24T22:03:52.627852+0000","last_clean":"2023-01-24T22:03:52.627852+0000","last_became_active":"2023-01-24T22:03:50.208212+0000","last_became_peered":"2023-01-24T22:03:50.208212+0000","last_unstale":"2023-01-24T22:03:52.627852+0000","last_undegraded":"2023-01-24T22:03:52.627852+0000","last_fullsized":"2023-01-24T22:03:52.627852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:13.078024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.213472+0000","last_change":"2023-01-24T22:03:50.205463+0000","last_active":"2023-01-24T22:03:51.213472+0000","last_peered":"2023-01-24T22:03:51.213472+0000","last_clean":"2023-01-24T22:03:51.213472+0000","last_became_active":"2023-01-24T22:03:50.205045+0000","last_became_peered":"2023-01-24T22:03:50.205045+0000","last_unstale":"2023-01-24T22:03:51.213472+0000","last_undegraded":"2023-01-24T22:03:51.213472+0000","last_fullsized":"2023-01-24T22:03:51.213472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:10.456514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.843372+0000","last_change":"2023-01-24T22:03:50.299943+0000","last_active":"2023-01-24T22:03:51.843372+0000","last_peered":"2023-01-24T22:03:51.843372+0000","last_clean":"2023-01-24T22:03:51.843372+0000","last_became_active":"2023-01-24T22:03:50.299289+0000","last_became_peered":"2023-01-24T22:03:50.299289+0000","last_unstale":"2023-01-24T22:03:51.843372+0000","last_undegraded":"2023-01-24T22:03:51.843372+0000","last_fullsized":"2023-01-24T22:03:51.843372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.027373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.213464+0000","last_change":"2023-01-24T22:03:50.200541+0000","last_active":"2023-01-24T22:03:51.213464+0000","last_peered":"2023-01-24T22:03:51.213464+0000","last_clean":"2023-01-24T22:03:51.213464+0000","last_became_active":"2023-01-24T22:03:50.200024+0000","last_became_peered":"2023-01-24T22:03:50.200024+0000","last_unstale":"2023-01-24T22:03:51.213464+0000","last_undegraded":"2023-01-24T22:03:51.213464+0000","last_fullsized":"2023-01-24T22:03:51.213464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:51.332158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.863591+0000","last_change":"2023-01-24T22:03:50.208605+0000","last_active":"2023-01-24T22:03:51.863591+0000","last_peered":"2023-01-24T22:03:51.863591+0000","last_clean":"2023-01-24T22:03:51.863591+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:51.863591+0000","last_undegraded":"2023-01-24T22:03:51.863591+0000","last_fullsized":"2023-01-24T22:03:51.863591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:50.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.600869+0000","last_change":"2023-01-24T22:03:51.600603+0000","last_active":"2023-01-24T22:03:51.600869+0000","last_peered":"2023-01-24T22:03:51.600869+0000","last_clean":"2023-01-24T22:03:51.600869+0000","last_became_active":"2023-01-24T22:03:51.500182+0000","last_became_peered":"2023-01-24T22:03:51.500182+0000","last_unstale":"2023-01-24T22:03:51.600869+0000","last_undegraded":"2023-01-24T22:03:51.600869+0000","last_fullsized":"2023-01-24T22:03:51.600869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:56.594734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.843417+0000","last_change":"2023-01-24T22:03:50.433437+0000","last_active":"2023-01-24T22:03:51.843417+0000","last_peered":"2023-01-24T22:03:51.843417+0000","last_clean":"2023-01-24T22:03:51.843417+0000","last_became_active":"2023-01-24T22:03:50.432652+0000","last_became_peered":"2023-01-24T22:03:50.432652+0000","last_unstale":"2023-01-24T22:03:51.843417+0000","last_undegraded":"2023-01-24T22:03:51.843417+0000","last_fullsized":"2023-01-24T22:03:51.843417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:05.736584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-24T22:03:51.963807+0000","last_change":"2023-01-24T22:03:50.308556+0000","last_active":"2023-01-24T22:03:51.963807+0000","last_peered":"2023-01-24T22:03:51.963807+0000","last_clean":"2023-01-24T22:03:51.963807+0000","last_became_active":"2023-01-24T22:03:50.208007+0000","last_became_peered":"2023-01-24T22:03:50.208007+0000","last_unstale":"2023-01-24T22:03:51.963807+0000","last_undegraded":"2023-01-24T22:03:51.963807+0000","last_fullsized":"2023-01-24T22:03:51.963807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:49.173045+0000","last_clean_scrub_stamp":"2023-01-24T22:03:49.173045+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:04:59.467367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"21'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-01-24T22:03:57.183249+0000","last_change":"2023-01-24T22:03:46.525743+0000","last_active":"2023-01-24T22:03:57.183249+0000","last_peered":"2023-01-24T22:03:57.183249+0000","last_clean":"2023-01-24T22:03:57.183249+0000","last_became_active":"2023-01-24T22:03:46.423738+0000","last_became_peered":"2023-01-24T22:03:46.423738+0000","last_unstale":"2023-01-24T22:03:57.183249+0000","last_undegraded":"2023-01-24T22:03:57.183249+0000","last_fullsized":"2023-01-24T22:03:57.183249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-24T22:03:45.139252+0000","last_clean_scrub_stamp":"2023-01-24T22:03:45.139252+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-24T22:05:09.515002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797624,"kb_used_data":92902376,"kb_used_omap":123,"kb_used_meta":0,"kb_avail":92901756,"statfs":{"total":95948165120,"available":95131398144,"internally_reserved":634880,"allocated":95132033024,"data_stored":95132033024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":126452,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5,0,0,6,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795796,"kb_used_data":92903584,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903584,"statfs":{"total":95948165120,"available":95133270016,"internally_reserved":0,"allocated":95133270016,"data_stored":95133270016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43872,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795788,"kb_used_data":92903592,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903592,"statfs":{"total":95948165120,"available":95133278208,"internally_reserved":0,"allocated":95133278208,"data_stored":95133278208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43954,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795668,"kb_used_data":92903712,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":92903712,"statfs":{"total":95948165120,"available":95133401088,"internally_reserved":0,"allocated":95133401088,"data_stored":95133401088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37844,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795796,"kb_used_data":92903584,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903584,"statfs":{"total":95948165120,"available":95133270016,"internally_reserved":0,"allocated":95133270016,"data_stored":95133270016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38528,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795796,"kb_used_data":92903584,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903584,"statfs":{"total":95948165120,"available":95133270016,"internally_reserved":0,"allocated":95133270016,"data_stored":95133270016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43990,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795796,"kb_used_data":92903584,"kb_used_omap":53,"kb_used_meta":0,"kb_avail":92903584,"statfs":{"total":95948165120,"available":95133270016,"internally_reserved":0,"allocated":95133270016,"data_stored":95133270016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54497,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7809999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797628,"kb_used_data":92902372,"kb_used_omap":115,"kb_used_meta":0,"kb_avail":92901752,"statfs":{"total":95948165120,"available":95131394048,"internally_reserved":634880,"allocated":95132028928,"data_stored":95132028928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":118230,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]}]}],"pool_statfs":[]}} 2023-01-24T22:04:01.044 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-24T22:04:01.044 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-01-24T22:04:01.327 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 22 2023-01-24T22:04:01.327 INFO:teuthology.orchestra.run.smithi100.stdout:fsid 2db70b95-3a95-440a-afc1-b7f5c81bdc31 2023-01-24T22:04:01.327 INFO:teuthology.orchestra.run.smithi100.stdout:created 2023-01-24T22:03:38.026102+0000 2023-01-24T22:04:01.327 INFO:teuthology.orchestra.run.smithi100.stdout:modified 2023-01-24T22:03:59.780374+0000 2023-01-24T22:04:01.328 INFO:teuthology.orchestra.run.smithi100.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-01-24T22:04:01.328 INFO:teuthology.orchestra.run.smithi100.stdout:crush_version 5 2023-01-24T22:04:01.328 INFO:teuthology.orchestra.run.smithi100.stdout:full_ratio 0.95 2023-01-24T22:04:01.328 INFO:teuthology.orchestra.run.smithi100.stdout:backfillfull_ratio 0.9 2023-01-24T22:04:01.329 INFO:teuthology.orchestra.run.smithi100.stdout:nearfull_ratio 0.85 2023-01-24T22:04:01.329 INFO:teuthology.orchestra.run.smithi100.stdout:require_min_compat_client luminous 2023-01-24T22:04:01.329 INFO:teuthology.orchestra.run.smithi100.stdout:min_compat_client jewel 2023-01-24T22:04:01.329 INFO:teuthology.orchestra.run.smithi100.stdout:require_osd_release quincy 2023-01-24T22:04:01.330 INFO:teuthology.orchestra.run.smithi100.stdout:stretch_mode_enabled false 2023-01-24T22:04:01.330 INFO:teuthology.orchestra.run.smithi100.stdout:pool 1 '.mgr' replicated size 2 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr 2023-01-24T22:04:01.330 INFO:teuthology.orchestra.run.smithi100.stdout:pool 2 'rbd' replicated size 2 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 application rbd 2023-01-24T22:04:01.330 INFO:teuthology.orchestra.run.smithi100.stdout:max_osd 8 2023-01-24T22:04:01.330 INFO:teuthology.orchestra.run.smithi100.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6806/23669,v1:172.21.15.100:6808/23669] [v2:172.21.15.100:6810/23669,v1:172.21.15.100:6811/23669] exists,up f82e6ad4-7872-466f-b01b-eb6b653addc4 2023-01-24T22:04:01.331 INFO:teuthology.orchestra.run.smithi100.stdout:osd.1 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6800/23668,v1:172.21.15.100:6801/23668] [v2:172.21.15.100:6802/23668,v1:172.21.15.100:6803/23668] exists,up bce6ee20-6fe8-4b58-aa20-071516ece6e4 2023-01-24T22:04:01.331 INFO:teuthology.orchestra.run.smithi100.stdout:osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6816/23670,v1:172.21.15.100:6817/23670] [v2:172.21.15.100:6818/23670,v1:172.21.15.100:6819/23670] exists,up 7a808a44-1075-4b54-80cd-c0086317e418 2023-01-24T22:04:01.331 INFO:teuthology.orchestra.run.smithi100.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6824/23671,v1:172.21.15.100:6825/23671] [v2:172.21.15.100:6826/23671,v1:172.21.15.100:6827/23671] exists,up 5881f204-14ab-4d03-b4d2-c3e8ac351dae 2023-01-24T22:04:01.331 INFO:teuthology.orchestra.run.smithi100.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6800/23728,v1:172.21.15.149:6801/23728] [v2:172.21.15.149:6802/23728,v1:172.21.15.149:6803/23728] exists,up df584ea4-577e-490e-a2e8-37efc69e1a23 2023-01-24T22:04:01.331 INFO:teuthology.orchestra.run.smithi100.stdout:osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6805/23729,v1:172.21.15.149:6807/23729] [v2:172.21.15.149:6810/23729,v1:172.21.15.149:6811/23729] exists,up a35dba97-9b8a-4549-9b5e-95ba459d9f59 2023-01-24T22:04:01.332 INFO:teuthology.orchestra.run.smithi100.stdout:osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6822/23741,v1:172.21.15.149:6824/23741] [v2:172.21.15.149:6826/23741,v1:172.21.15.149:6827/23741] exists,up f2171016-dac7-4142-b992-ca31661b8ace 2023-01-24T22:04:01.332 INFO:teuthology.orchestra.run.smithi100.stdout:osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6816/23730,v1:172.21.15.149:6817/23730] [v2:172.21.15.149:6818/23730,v1:172.21.15.149:6819/23730] exists,up 540d4c28-a22b-4105-8464-884cc72aa0f1 2023-01-24T22:04:01.345 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6806/23669,v1:172.21.15.100:6808/23669] [v2:172.21.15.100:6810/23669,v1:172.21.15.100:6811/23669] exists,up f82e6ad4-7872-466f-b01b-eb6b653addc4', 'osd.1 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6800/23668,v1:172.21.15.100:6801/23668] [v2:172.21.15.100:6802/23668,v1:172.21.15.100:6803/23668] exists,up bce6ee20-6fe8-4b58-aa20-071516ece6e4', 'osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6816/23670,v1:172.21.15.100:6817/23670] [v2:172.21.15.100:6818/23670,v1:172.21.15.100:6819/23670] exists,up 7a808a44-1075-4b54-80cd-c0086317e418', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6824/23671,v1:172.21.15.100:6825/23671] [v2:172.21.15.100:6826/23671,v1:172.21.15.100:6827/23671] exists,up 5881f204-14ab-4d03-b4d2-c3e8ac351dae', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6800/23728,v1:172.21.15.149:6801/23728] [v2:172.21.15.149:6802/23728,v1:172.21.15.149:6803/23728] exists,up df584ea4-577e-490e-a2e8-37efc69e1a23', 'osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6805/23729,v1:172.21.15.149:6807/23729] [v2:172.21.15.149:6810/23729,v1:172.21.15.149:6811/23729] exists,up a35dba97-9b8a-4549-9b5e-95ba459d9f59', 'osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6822/23741,v1:172.21.15.149:6824/23741] [v2:172.21.15.149:6826/23741,v1:172.21.15.149:6827/23741] exists,up f2171016-dac7-4142-b992-ca31661b8ace', 'osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6816/23730,v1:172.21.15.149:6817/23730] [v2:172.21.15.149:6818/23730,v1:172.21.15.149:6819/23730] exists,up 540d4c28-a22b-4105-8464-884cc72aa0f1'] 2023-01-24T22:04:01.345 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-01-24T22:04:01.443 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-01-24T22:04:01.444 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mon.a", 2023-01-24T22:04:01.444 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster": "ceph", 2023-01-24T22:04:01.445 INFO:teuthology.orchestra.run.smithi100.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-01-24T22:04:01.445 INFO:teuthology.orchestra.run.smithi100.stdout: "admin_socket_mode": "", 2023-01-24T22:04:01.446 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-01-24T22:04:01.446 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_client_required": "cephx, none", 2023-01-24T22:04:01.446 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_cluster_required": "cephx", 2023-01-24T22:04:01.447 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_debug": "true", 2023-01-24T22:04:01.447 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-01-24T22:04:01.447 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-01-24T22:04:01.448 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_service_required": "cephx", 2023-01-24T22:04:01.448 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_service_ticket_ttl": "240.000000", 2023-01-24T22:04:01.449 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_supported": "cephx", 2023-01-24T22:04:01.449 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_aio": "true", 2023-01-24T22:04:01.449 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_aio_max_queue_depth": "1024", 2023-01-24T22:04:01.450 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_aio_poll_ms": "250", 2023-01-24T22:04:01.450 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_aio_reap_max": "16", 2023-01-24T22:04:01.451 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_async_discard": "false", 2023-01-24T22:04:01.451 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_block_size": "4096", 2023-01-24T22:04:01.452 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_debug_aio": "false", 2023-01-24T22:04:01.452 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-01-24T22:04:01.452 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-01-24T22:04:01.453 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_debug_inflight_ios": "false", 2023-01-24T22:04:01.453 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_enable_discard": "false", 2023-01-24T22:04:01.454 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_flock_retry": "3", 2023-01-24T22:04:01.456 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_flock_retry_interval": "0.100000", 2023-01-24T22:04:01.456 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_inject_crash": "0", 2023-01-24T22:04:01.456 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_inject_crash_flush_delay": "2", 2023-01-24T22:04:01.456 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_ioring": "false", 2023-01-24T22:04:01.457 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_ioring_hipri": "false", 2023-01-24T22:04:01.457 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_ioring_sqthread_poll": "false", 2023-01-24T22:04:01.457 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-01-24T22:04:01.457 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_read_buffer_alignment": "4096", 2023-01-24T22:04:01.457 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-01-24T22:04:01.458 INFO:teuthology.orchestra.run.smithi100.stdout: "bdev_type": "", 2023-01-24T22:04:01.458 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_alloc_size": "1048576", 2023-01-24T22:04:01.458 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_allocator": "hybrid", 2023-01-24T22:04:01.458 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_buffered_io": "true", 2023-01-24T22:04:01.459 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_check_for_zeros": "false", 2023-01-24T22:04:01.459 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_check_volume_selector_often": "false", 2023-01-24T22:04:01.459 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-01-24T22:04:01.459 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_compact_log_sync": "false", 2023-01-24T22:04:01.459 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-01-24T22:04:01.460 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_log_compact_min_size": "16777216", 2023-01-24T22:04:01.460 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_log_replay_check_allocations": "true", 2023-01-24T22:04:01.460 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_max_log_runway": "4194304", 2023-01-24T22:04:01.460 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_max_prefetch": "1048576", 2023-01-24T22:04:01.460 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_min_flush_size": "524288", 2023-01-24T22:04:01.461 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_min_log_runway": "1048576", 2023-01-24T22:04:01.461 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_replay_recovery": "false", 2023-01-24T22:04:01.461 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-01-24T22:04:01.461 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_shared_alloc_size": "65536", 2023-01-24T22:04:01.462 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_sync_write": "false", 2023-01-24T22:04:01.462 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-01-24T22:04:01.462 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-01-24T22:04:01.462 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-01-24T22:04:01.463 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_allocation_from_file": "true", 2023-01-24T22:04:01.464 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_allocator": "hybrid", 2023-01-24T22:04:01.464 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-01-24T22:04:01.464 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-01-24T22:04:01.464 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-01-24T22:04:01.464 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-01-24T22:04:01.465 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-01-24T22:04:01.465 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-01-24T22:04:01.465 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blobid_prealloc": "10240", 2023-01-24T22:04:01.465 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_block_create": "true", 2023-01-24T22:04:01.466 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_block_db_create": "false", 2023-01-24T22:04:01.466 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_block_db_path": "", 2023-01-24T22:04:01.466 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_block_db_size": "0", 2023-01-24T22:04:01.466 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_block_path": "", 2023-01-24T22:04:01.466 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_block_preallocate_file": "false", 2023-01-24T22:04:01.467 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_block_size": "107374182400", 2023-01-24T22:04:01.467 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_block_wal_create": "false", 2023-01-24T22:04:01.467 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_block_wal_path": "", 2023-01-24T22:04:01.467 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_block_wal_size": "100663296", 2023-01-24T22:04:01.468 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_bluefs": "true", 2023-01-24T22:04:01.468 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-01-24T22:04:01.468 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_bluefs_env_mirror": "false", 2023-01-24T22:04:01.468 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-01-24T22:04:01.469 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-01-24T22:04:01.469 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-01-24T22:04:01.469 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-01-24T22:04:01.470 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-01-24T22:04:01.471 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-01-24T22:04:01.471 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_autotune": "true", 2023-01-24T22:04:01.471 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-01-24T22:04:01.472 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-01-24T22:04:01.472 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-01-24T22:04:01.472 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-01-24T22:04:01.473 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_size": "0", 2023-01-24T22:04:01.473 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-01-24T22:04:01.473 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-01-24T22:04:01.473 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-01-24T22:04:01.474 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-01-24T22:04:01.474 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_type": "2q", 2023-01-24T22:04:01.474 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-01-24T22:04:01.474 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_clone_cow": "true", 2023-01-24T22:04:01.475 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_compression_algorithm": "snappy", 2023-01-24T22:04:01.475 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_compression_max_blob_size": "0", 2023-01-24T22:04:01.475 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-01-24T22:04:01.476 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-01-24T22:04:01.476 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_compression_min_blob_size": "0", 2023-01-24T22:04:01.476 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-01-24T22:04:01.476 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-01-24T22:04:01.477 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_compression_mode": "none", 2023-01-24T22:04:01.477 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-01-24T22:04:01.477 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_csum_type": "crc32c", 2023-01-24T22:04:01.477 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_enforce_settings": "default", 2023-01-24T22:04:01.478 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_freelist": "false", 2023-01-24T22:04:01.478 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_fsck_abort": "false", 2023-01-24T22:04:01.478 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_inject_bug21040": "false", 2023-01-24T22:04:01.479 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-01-24T22:04:01.479 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_inject_read_err": "false", 2023-01-24T22:04:01.479 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_legacy_omap": "false", 2023-01-24T22:04:01.479 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-01-24T22:04:01.479 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-01-24T22:04:01.480 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-01-24T22:04:01.480 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-01-24T22:04:01.480 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_prefill": "0.000000", 2023-01-24T22:04:01.481 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-01-24T22:04:01.481 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-01-24T22:04:01.481 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-01-24T22:04:01.481 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_small_allocations": "0", 2023-01-24T22:04:01.481 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-01-24T22:04:01.482 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_default_buffered_read": "true", 2023-01-24T22:04:01.482 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_default_buffered_write": "false", 2023-01-24T22:04:01.482 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_deferred_batch_ops": "0", 2023-01-24T22:04:01.482 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-01-24T22:04:01.482 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-01-24T22:04:01.483 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-01-24T22:04:01.483 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-01-24T22:04:01.483 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-01-24T22:04:01.483 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-01-24T22:04:01.484 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-01-24T22:04:01.484 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fail_eio": "false", 2023-01-24T22:04:01.484 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-01-24T22:04:01.484 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-01-24T22:04:01.485 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-01-24T22:04:01.485 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-01-24T22:04:01.485 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_on_mkfs": "true", 2023-01-24T22:04:01.485 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-01-24T22:04:01.485 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_on_mount": "false", 2023-01-24T22:04:01.486 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-01-24T22:04:01.486 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_on_umount": "false", 2023-01-24T22:04:01.486 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-01-24T22:04:01.486 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-01-24T22:04:01.486 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-01-24T22:04:01.487 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-01-24T22:04:01.487 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-01-24T22:04:01.487 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-01-24T22:04:01.487 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-01-24T22:04:01.487 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-01-24T22:04:01.488 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_ignore_data_csum": "false", 2023-01-24T22:04:01.488 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-01-24T22:04:01.488 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_kvbackend": "rocksdb", 2023-01-24T22:04:01.489 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-01-24T22:04:01.489 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-01-24T22:04:01.490 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_log_op_age": "5.000000", 2023-01-24T22:04:01.490 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_max_alloc_size": "0", 2023-01-24T22:04:01.490 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_max_blob_size": "0", 2023-01-24T22:04:01.491 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-01-24T22:04:01.491 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-01-24T22:04:01.491 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_max_defer_interval": "3.000000", 2023-01-24T22:04:01.491 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_max_deferred_txc": "32", 2023-01-24T22:04:01.491 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_min_alloc_size": "0", 2023-01-24T22:04:01.492 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-01-24T22:04:01.492 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-01-24T22:04:01.492 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_nid_prealloc": "1024", 2023-01-24T22:04:01.492 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_prefer_deferred_size": "0", 2023-01-24T22:04:01.492 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-01-24T22:04:01.493 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-01-24T22:04:01.493 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_qfsck_on_mount": "true", 2023-01-24T22:04:01.493 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_retry_disk_reads": "3", 2023-01-24T22:04:01.493 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_rocksdb_cf": "true", 2023-01-24T22:04:01.494 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P", 2023-01-24T22:04:01.494 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2,max_total_wal_size=1073741824", 2023-01-24T22:04:01.494 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_rocksdb_options_annex": "", 2023-01-24T22:04:01.494 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_spdk_coremask": "0x1", 2023-01-24T22:04:01.494 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_spdk_io_sleep": "5", 2023-01-24T22:04:01.495 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_spdk_max_io_completion": "0", 2023-01-24T22:04:01.495 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_spdk_mem": "512", 2023-01-24T22:04:01.495 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_sync_submit_transaction": "false", 2023-01-24T22:04:01.495 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_throttle_bytes": "67108864", 2023-01-24T22:04:01.495 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_throttle_cost_per_io": "0", 2023-01-24T22:04:01.496 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-01-24T22:04:01.496 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-01-24T22:04:01.496 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-01-24T22:04:01.496 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-01-24T22:04:01.496 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_tracing": "false", 2023-01-24T22:04:01.497 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-01-24T22:04:01.497 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-01-24T22:04:01.497 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_volume_selection_reserved": "0", 2023-01-24T22:04:01.497 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-01-24T22:04:01.497 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-01-24T22:04:01.498 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-01-24T22:04:01.498 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-01-24T22:04:01.498 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-01-24T22:04:01.498 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-01-24T22:04:01.498 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_zero_block_detection": "false", 2023-01-24T22:04:01.499 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-01-24T22:04:01.499 INFO:teuthology.orchestra.run.smithi100.stdout: "cephfs_mirror_action_update_interval": "2", 2023-01-24T22:04:01.499 INFO:teuthology.orchestra.run.smithi100.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-01-24T22:04:01.499 INFO:teuthology.orchestra.run.smithi100.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-01-24T22:04:01.499 INFO:teuthology.orchestra.run.smithi100.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-01-24T22:04:01.500 INFO:teuthology.orchestra.run.smithi100.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-01-24T22:04:01.500 INFO:teuthology.orchestra.run.smithi100.stdout: "cephfs_mirror_mount_timeout": "10", 2023-01-24T22:04:01.500 INFO:teuthology.orchestra.run.smithi100.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-01-24T22:04:01.500 INFO:teuthology.orchestra.run.smithi100.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-01-24T22:04:01.500 INFO:teuthology.orchestra.run.smithi100.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-01-24T22:04:01.501 INFO:teuthology.orchestra.run.smithi100.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-01-24T22:04:01.501 INFO:teuthology.orchestra.run.smithi100.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-01-24T22:04:01.501 INFO:teuthology.orchestra.run.smithi100.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-01-24T22:04:01.501 INFO:teuthology.orchestra.run.smithi100.stdout: "cephx_cluster_require_signatures": "false", 2023-01-24T22:04:01.501 INFO:teuthology.orchestra.run.smithi100.stdout: "cephx_cluster_require_version": "2", 2023-01-24T22:04:01.502 INFO:teuthology.orchestra.run.smithi100.stdout: "cephx_require_signatures": "false", 2023-01-24T22:04:01.502 INFO:teuthology.orchestra.run.smithi100.stdout: "cephx_require_version": "2", 2023-01-24T22:04:01.502 INFO:teuthology.orchestra.run.smithi100.stdout: "cephx_service_require_signatures": "false", 2023-01-24T22:04:01.503 INFO:teuthology.orchestra.run.smithi100.stdout: "cephx_service_require_version": "2", 2023-01-24T22:04:01.503 INFO:teuthology.orchestra.run.smithi100.stdout: "cephx_sign_messages": "true", 2023-01-24T22:04:01.503 INFO:teuthology.orchestra.run.smithi100.stdout: "chdir": "", 2023-01-24T22:04:01.503 INFO:teuthology.orchestra.run.smithi100.stdout: "client_acl_type": "", 2023-01-24T22:04:01.503 INFO:teuthology.orchestra.run.smithi100.stdout: "client_asio_thread_count": "2", 2023-01-24T22:04:01.504 INFO:teuthology.orchestra.run.smithi100.stdout: "client_cache_mid": "0.750000", 2023-01-24T22:04:01.504 INFO:teuthology.orchestra.run.smithi100.stdout: "client_cache_size": "16384", 2023-01-24T22:04:01.504 INFO:teuthology.orchestra.run.smithi100.stdout: "client_caps_release_delay": "5", 2023-01-24T22:04:01.504 INFO:teuthology.orchestra.run.smithi100.stdout: "client_check_pool_perm": "true", 2023-01-24T22:04:01.504 INFO:teuthology.orchestra.run.smithi100.stdout: "client_collect_and_send_global_metrics": "false", 2023-01-24T22:04:01.505 INFO:teuthology.orchestra.run.smithi100.stdout: "client_debug_force_sync_read": "false", 2023-01-24T22:04:01.505 INFO:teuthology.orchestra.run.smithi100.stdout: "client_debug_getattr_caps": "false", 2023-01-24T22:04:01.505 INFO:teuthology.orchestra.run.smithi100.stdout: "client_debug_inject_tick_delay": "0", 2023-01-24T22:04:01.505 INFO:teuthology.orchestra.run.smithi100.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-01-24T22:04:01.505 INFO:teuthology.orchestra.run.smithi100.stdout: "client_die_on_failed_remount": "false", 2023-01-24T22:04:01.506 INFO:teuthology.orchestra.run.smithi100.stdout: "client_dirsize_rbytes": "true", 2023-01-24T22:04:01.506 INFO:teuthology.orchestra.run.smithi100.stdout: "client_force_lazyio": "false", 2023-01-24T22:04:01.506 INFO:teuthology.orchestra.run.smithi100.stdout: "client_fs": "", 2023-01-24T22:04:01.506 INFO:teuthology.orchestra.run.smithi100.stdout: "client_inject_fixed_oldest_tid": "false", 2023-01-24T22:04:01.506 INFO:teuthology.orchestra.run.smithi100.stdout: "client_inject_release_failure": "false", 2023-01-24T22:04:01.507 INFO:teuthology.orchestra.run.smithi100.stdout: "client_max_inline_size": "4096", 2023-01-24T22:04:01.507 INFO:teuthology.orchestra.run.smithi100.stdout: "client_mds_namespace": "", 2023-01-24T22:04:01.507 INFO:teuthology.orchestra.run.smithi100.stdout: "client_metadata": "", 2023-01-24T22:04:01.507 INFO:teuthology.orchestra.run.smithi100.stdout: "client_mount_gid": "-1", 2023-01-24T22:04:01.507 INFO:teuthology.orchestra.run.smithi100.stdout: "client_mount_timeout": "300", 2023-01-24T22:04:01.508 INFO:teuthology.orchestra.run.smithi10